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13  ABSTRACT 


This, is  a  study  of  the  structure  of  engineering  systems  with  respect  to  time 
related  behavior.  The  development  is  unconventional  in  not  being  based  oniystem 
properties  such  as  linearity,  time  invariance,  etc.  The  main  question  of  interest 
concerns  the  possibility  of  decomposing  a  general  system  into  a  sum  of  systems  with 
less  complex  time  related  behavior.  An  analysis  of  characteristic  properties  of 
such  systei::s  and  their  interconnection  with  other  aspects  of  system  behavior  is 
also  made.  The  approach  used  in  the  study  is  Afunctional  analytic,”  making  use  of 
recently  developed  axiom.atic  stiuctures  called  the  group  resolution  space  and  Hilbert 
resolution  space.  This  in  turn  permits  the  efficient  utilization  of  powerful 
techniques  from  the  Gohberg-Krein  theory  of  Volterra  operators.  The  most  important 
result  of  the  study  is  a  canonical  causaliy  decomposition  theorem.  Other  results 
include  a  theorem  connecting  the  temporal  properties  of  an  open  loop  system  to  the 
stability  of  the  closed  loop  feedback  system. 
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ABSTRACT 


CAUSALITY  STRUCTURE  OF  ENGINEERING  SYSTEMS 

by 

Romano  Mario  De  Santis 

Charman:  William  A.  Porter 

This  study  is  about  the  structure  of  engineering  systems  with 
respect  to  time  related  behavior.  Studies  of  this  type  are  usually 
based  on  such  system  properties  as  linearity,  time  invariance, 
contin  ty  and  physical  realizability.  A  distinguishing  character  of 
the  p  esent  development  is  that  none  of  these  properties  is  essential. 
This  explains  in  part  the  unconventional  character  of  questions, 

f 

apprr  ach  and  results. 

‘tn  contrast  to  a  physically  realizable  system,  an  engineering 
syster need  not  be  causal  and  may  present  a  complex  time  related 
behavi  ir.  The  main  question  of  interest  concerns  then  the  possibility 

I 

of  decomposing  a  general  system  into  the  sum  ol  systems  with  a  time 
related  behavior  which  is,  in  some  sense,  "simple".  The  analysis 
of  characteristic  properties  of  such  systems  and  of  their  intercon¬ 
nections  with  other  aspects  of  system  behavior  is  also  a  relevant 
question  of  investigation. 

The  above  questions  are  applicable  to  many  and  diverse  engi¬ 
neering  fields  and  the  desirability  of  an  abstract  approach  is  quite 


ah 


natural.  The  approach  adopted  in  this  study  can  be  described  as 
♦functional  analytic’*  and  makes  use  of  recently  developed  axiomatic 
structures  called  group  resolution  space  and  Hilbert  resolution  space. 
This  not  only  provides  a  natural  framework  in  which  to  embed  the 
intended  research,  but  it  also  permits  an  efficient  utilization  of 
powerful  techniques  from  the  Gohberg-Krein  theory  of  Volterra 
operators. 

The  most  important  result  of  this  study  is  a  canonical  cai'sality 
decomposition  theorem.  This  theorem  states  that  under  appropriate 
hypotheses  every  engineering  system  can  be  represented  as  the  sum 
of  "simple**  systems.  Another  relevant  theorem  connects  the  tem¬ 
poral  properties  of  an  open  loop  system  to  the  stability  of  the  closed 
loop  feedback  system. 
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The  results  of  this  thesis  are  reported  under  the  labels  of  lemix?ab, 
propositions,  and  theorems.  The  results  appearing  as  ^^n'mas  have  been 
borrowed  from  the  reie.  ences.  Unless  otherwise  stated,  all  the  results 
labeled  propositions  and  theorems  are  original  to  the  best  the  author’s 
knowledge. 


1.  INTRODUCTION 

1. 1  Introduction 

When  the  concepts  of  time  and  its  associates  -  past,  present 
and  future  -  are  extended  from  the  world  of  physical  systems  into 
the  broader  context  of  engineering  systems  they  become  abstract 
entities.  They  may  then  preserve  little  in  common  with  the  original 
notion  of  physical  "fourth  dimension"  and  the  terms  real  and  nonreal 
time  are  often  adopted. 

Heuristically,  a  system  is  called  causal  if  "present  behavior" 
of  the  system  is  only  a  function  of  the  past.  In  this  regard  a  widely 
accepted  axiom  is  the  principle  of  causality:  all  physical  systems 
are  causal.  As  engineering  systems  need  not  be  physical  nor  do  they 
necessarily  function  in  real  time,  it  is  quite  natural  that  for  these 
systems  the  assumption  of  causality  is  no  longer  valid. 

Indeed,  in  the  ei^ineering  domain  it  is  not  unusual  to  be  faced  i 

} 

with  problems  related  to  noncausal  behavior.  Classical  filter ir^  and 
estimation  problems  in  communication  theory  do  not  necessarily  have 
a  causal  solution  [  14],  [  35j.  In  stability  theory  the  instability  of 
a  large  class  of  linear  time  invariant  systems  can  be  explained  in 

! 

terms  of  absence  of  causality  [11  ],  [59],  In  optimal  control  theory  j 

i 

noncausal  controllers  occur  regularly  in  minimum  effort,  minimum  | 

I 

fuel,  and  optimal  time  problems  [41  ],  [44  ].  I 
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In  the  implementation  of  an  engineering  system  the'  requirement 
that  the  system  be  causal  is  important.  ■  In  particular  if  the  imple¬ 
mentation  has  to  be  physical,  tt\en  this  requirement  becomes  manda¬ 
tory.  When  this  happens  one  either  confines  himself  to  consider  only 
causal  systems  [9  ],  [63],  [68],  [  69],  or,  in  an  alternative  approach, 
one  lifts  the  causality  constraint  in  a  preliminary  phase  of  the  design 
and  reconsiders  it  in  a  later  phase  [30],  [  66].  In  this  latter  instance, 

t 

usually  an  analysis  of  the  causality  structure  of  the  system  is  in  order 
[48]. 

I 

This  then  explains  one  characteristic  of  the  present  de/e)opment: 

a  stuay  about  time  related  behavioral  patterns  of  eiigineering  systems. 

■  *  1 

That  is,  anout  the  modalities  by  which  past,  present  and  future  of  the 
input  affect  the  present  of  the  output.  In  the  context  of  this  study 

t  1  '  ' 

causal  and  noncausal  as  well  as  linear  and  nonlinear  systems  are 
considered. 

A  proper  characterization  of  the  natur'e  of  time  behavioral  pat¬ 
terns  may  suggest  var  ious  engineering  implications.  For  instance, 
the  fact  that  a  system  h."!s  noncausal  behavior  implies  that ’t  cannot 
be  physically  implemented.  On  the  other  hand,  if  ♦he  noncausal 
behavior  is,  in  some  sense,  "almost  causal"  then,  for  engineering 
purposes,  ihe  system  can  still  enjoy  the  property  of  physical  imple¬ 


mentation. 
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To  mention  other  types  of  implications  note  that  in  linear 
systems  theory  the  fact  that  a  physical  realization  of  a  linear  time 
invariant  dynamical  system  defines  uniquely  the  input-output  weighting 
pattern  of  the  system  [  65]  can  be  viewed  as  a  consequence  of  the 
special  causality  structure  of  the  system.  Similarly,  in  stability 
theory  some  special  causality  properties  of  an  open  loop  system  can 
imply  the  stability  of  the  closed  loop  feedback  system  [  H  ],  [  12  ], 
[131*. 

A  second  characteristic  of  this  development  will,  at  this  point, 
appear  natural;  the  study  of  interconnections  between  time  related 
behavioral  patterns  and  other  aspects  of  system  behavior.  In  this 
regard  intercoimections  between  state  and  causality  structures  are 
investigated.  An  additional  topic  of  research  is  the  study  of  relations 
between  stability  and  causality  properties. 

in  a  broad  sense  a  study  ol  the  present  type  falls  into  the  context 
of  causality  theory.  On  the  other  hand,  empiiasis  here  is  on  systems 
v.hich  do  not  necessarily  enjoy  those  properties  on  which  much  of  the 
previous  research  on  causality  is  based,  namely:  linearity,  time 
invariance,  continuity,  and  most  notable  causality.  It  is  then  not 
surprising  if  the  classical  theory  on  causality  presents  limitations 
in  this  area. 

♦Other  significant  implications  can  a.'so  be  envisioned  in  less 
academic  and  more  earthly  engineering  ax*eas.  Here  the  reader  is 
referred  to  Appendix  A, 


4 


In  particular,  for  instance,  the  technical  literature  has  paid 
scant  attention  to  the  study  of  noncausal  systems.  Apparently  this 
situation  has  been  justified  by  the  feeling  that  noncausal  behavior  can 
be  treated  as  causal  behavior  in  reverse  time.  This  suits  quite  well 
studies  confined  to  physical  systems  and,  to  a  certain  extent,  linear 
systems  [  48  ].  However,  such  an  approach  is  not  applicable  to  the 
type  of  problems  considered  here. 

A  more  general  approach  has  recently  been  adopted  by  Porter 
[41],  [42]  and  Sacks  [  48  ],  [  49  ].  These  references  treat  causal  and 
noncausal  systems  on  an  equal  footing  and  provide  much  of  the  ideas 
and  inspiration  for  the  present  development.  These  efforts  are, 
however,  mostly  confined  to  the  study  of  linear  systems  in  a  Banach 
or  a  Hilbert  space  context.  Many  systems  of  interest,  however,  not 
only  are  not  linear  but,  most  important,  cannot  be  fitted  in  any  Banach 
or  Hilbert  space  framework. 

The  above  discussion  allows  us  to  introduce  a  third  and  perhaps 
most  relevant  characteristic  of  this  study;  the  abstract  approach.  The 
desirability  of  an  abstract  treatment  is  quite  natural  in  view  of  the 
many  and  diverse  engineering  fields  in  which  the  subject  applies.  To 
those  fields  already  mentioned  we  can,  for  instance,  add  game  theory, 
decision  theory,  prediction  theory,  electric  network  theory  and  others. 
Some  of  the  advant^es  of  abstraction  are  then  evident:  the  possibility 
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of  emphasizing  those  features  which  are  truly  connected  to  time 
related  beltavior;  t’  e  unification  of  diverse  classes  of  problems;  the 
possibility  of  obtaining  results  with  a  wide  range  of  applicability;  the 
contribution  to  studies  wilh  an  interdisciplinary  character. 

1.2  Organization 

Commensurate  with  the  discussion  in  the  previous  section  we  will 
treat  the  following  topics:  i)  identification,  analysis  and  physical  inter¬ 
pretation  of  those  systems  which,  in  some  sense,  are  ’'basic**  with 
respect  to  time  related  behavior;  ii)  consideration  of  the  question 
whether  a  general  system  can  be  decomposed  into  the  sum  of  basic 
systems;  iii)  investigation  of  some  connections  between  causality  and 
other  system  theoretic  properties. 

The  development  of  topics  i)  and  ii)  is  carried  out  in  Chapters 
2  and  4.  More  specifically.  Chapter  2  considers  systems  with  a  mathe¬ 
matical  representation  (group  resolution  spaces)  which  is  "minimal*' 
for  this  type  of  study  and  does  not  possess  any  topological  structure. 
Chapter  4  deals  with  linear  and  nonlinear  systems  defined  on  a  Hilbert 
space. 

Topic  iii)  is  treated  in  Chapters  3  and  5.  In  Chapter  3  some 
connections  between  causality  and  state  structures  are  studied.  This 
study  is  embedded  in  a  group  resolution  space  context.  Chapter  5 
investigates  some  connections  between  special  causality  properties 


of  an  open  loop  system  and  the  stability  properties  of  the  closed  loop 
feedback  system.  Here  the  system  is  modeled  by  a  mapping  on  a 
Hilbert  space. 

1. 3  A  General  Summary  of  Results 

A  general  theory  of  the  causality  related  structure  of  engineering 
systems  has  been  developed.  The  mathematical  framework  in  which 
this  theory  is  Imbedded  is  called  group  resolution  space.  In  this  setting 
we  identify  and  study  various  "basic”  systems:  causal  (strongly,  strictly) , 
anticausal  (strongly,  strictly), crosscar.sal  (stiongly,  strictly),  and 
memoryless.  Relevant  properties  of  these  systems  are  illuminated  by 
Propositions  2. 4. 1-6  and  2. 5. 1-6. 

The  concepts  of  causal,  anticausal,  and  memoryless  systems  are 
in  agreement  with  those  already  appearing  in  the  technical  literature. 

The  concept  of  crosscausality  is  new  and  plays  an  essential  role  in  the 
extension  of  the  available  theory  of  causality  into  a  nonlinear  systems 
context.  When  a  group  resolution  space  (GRS)  becomes  a  Hilbert 
resolution  space  (HRS) ,  these  concepts  have  a  natural  and  straight¬ 
forward  extension.  Some  aspects  of  this  extension  are  illustrated  by 
Definitions  4. 3. 1-6  and  Propositions  4. 4. 1-4.  Moreover  if  we  restrict 
our  interest  to  linear  systems  in  a  Hilbert  resolution  space,  then  our 
framework  coincides  with  the  one  which  was  adopted  by  Sr:eks  as  a 
starting  point.  This  allows  one  to  rediscover  results  which  had 
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already  been  stated  by  Saeks  (Propositions  4. 7. 1-3) .  New  results  in 
line  with  Saek's  development  are  also  obtained  (Theorem  4.  5. 1,  and 
Propositions  4.  5. 1-3  and  4. 7. 6-10) 

In  GRS  various  forms  of  a  causality  canonical  decomposition 
Theorem  can  be  obtained  (Theorem  2. 6. 1) .  A  typical  statement  of 
this  theorem  is  as  follows:  every  system  in  a  GRS  can  be  decomposed 
into  the  sum  of  causal,  anticausal,  crosscausal,  and  memoryless 
systems.  When  we  confine  our  attention  to  weakly  additive  systems 
then  crosscausal  operators  disappear  and  most  of  our  results 
assume  the  familiar  formulation  of  those  results  which  have  been  stated 
by  other  authors  in  the  case  of  linear  systems  in  HRS  (Theorem  2.  7. 1 
and  Propositions  2.  7. 1  -  4) . 

In  a  HRS  context  it  is  found  that  a  causality  canonical  decompo¬ 
sition  theorem  cannot  in  general  be  stated.  However  necessary  and 
sufficient  conditions  for  a  canonical  decomposition  to  exist  can  be 
given  (Theorems  4. 6. 1  and  4. 7. 1) .  These  conditions  are  utilized  to 
study  the  causality  structure  of  various  classes  of  special  systen.s. 

In  particular  it  is  shown  that  a  Hilbert  Schmidt  system  admits  a 
canonical  causality  decomposition.  Moreover  the  components  of  such 
a  decomposition  are  mutually  orthogonal  (Theorem  4.  8. 1  and  Proposition 
4.8. 1-3). 

The  GRS  framework  is  also  utilized  to  study  some  common  features 
of  causality  and  state  concepts.  To  do  this  we  first  generalize  the  notion 
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of  state  which  was  developed  by  Saeks  [  49  ]  and  illustrate  some 
important  aspects  of  this  generalization  (Proposition  3. 3. 1-4) .  We 
proceed  then  to  investigate  meaningful  interconnecticns  between 
state  and  causality  properties.  In  this  regard  Theorem  3. 4. 1  relates 
the  identification  of  basic  causality  components  of  a  system  with  its 
state  and  costate  decompositions.  Additional  results  can  also  be  found 
in  the  statements  of  Propositions  3. 4. 1  -  6. 

The  final  part  of  this  thesis  is  concerned  with  the  study  of  inter- 
connecticns  between  causality  and  stability  .  For  this  purpose  we 
consider  a  basic  feedback  system  in  HRS  and  relate  some  causality 
properties  of  an  open  loop  system  to  the  stability  of  the  closed  loop 
system.  Important  results  here  are  provided  by  7’heorems  5. 2. 1, 

5. 3. 1  and  5. 4. 1.  Some  relevant  implications  of  these  theorems  are 
illustrated  by  Propositions  5.4. 1-4. 

1.4  A  Brief  Review  of  Research  on  Causality 

Questions  concerning  causality  related  concepts  have  been  a 
focus  of  modern  scientific  research  for  a  number  of  decades.  Most 
of  this  research  is  directed  to  the  stv.dy  of  the  principle  of  causality 
and  its  implications  in  various  aspects  of  system  behavior.  These 
implications  range  from  constraints  on  the  frequency  response  of 
single  variate  linear,  time  invariant  systems,  to  a  number  of  more 
involved  properties  for  the  so  called  "collision  matrix"  of  infinite 
dimensional  systems  defined  by  various  scattering  processes 
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j  55  j,  I  56],  ]  6i  |,  The  above  tyi)e  of  properties  are  usually  categori¬ 
zed  with  the  title  of  dispersion  relations  [  ^  j.  [  "^  ]• 

The  invest^ation  of  the  connections  between  the  principle  of 
causality  and  dispersion  relations  has  long  been  the  objective  of  con¬ 
siderable  research.  Among  others  this  research  is  marked  by  the 
contributions  of  Paley  and  Wiener,  Foures  and  Segal,  Toll  and  Youla, 
Castriota  and  Carlin. 

Paley  and  Wiener  [  38]  can  be  considered  the  pioneers  of  ihe 
modern  study  on  causality.  Their  famous  Paley-Wiener  theorem  gave 
necessary  and  sufficient  conditions  for  the  modulus  of  a  frequency 
response  function  to  represent  a  causal  system.  This  theorem  is  the 
basis  for  much  of  the  subsequent  related  classical  work  on  causality. 

Using  the  Paley-Wiener  theorem,  Toll  obtained  additional 
formulation  of  necessary  and  sufficient  conditions  [  55  ].  Here  causality 
is  associated  with  analytical  properties  of  the  frequency  response  func¬ 
tion  when  its  domain  is  extended  from  the  imaginary  axis  to  the  complex 
plane. 

Similar  conditions  were  offered  by  Foures  and  Segal  f  20  1.  Later 
on  Youla,  Castriota  and  Carlin  extended  these  results  to  the  frequency 
response  matrix  function  of  linear  passive  n-port  networks  [63  ]. 

The  mathematical  techniques  supporting  the  above  developments 
are  essentially  centered  on  the  theory  of  functions  of  complex  variables 
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and  Fourier  integrrds.  In  a  somewhat  different  context  the  properties 
of  causal  systems  have  also  been  studied  by  Sandberg  [  51],  Falb  and 
Freedman  [  19  ] . 

Sandberg  considered  nonlinear  systems  on  a  Hilbert  space  context 
and  obtained  seme  necessary  conditions  for  causality  in  terms  of  phy¬ 
sically  meaningful  quantities.  Falb  and  Freedman  focused  their 
attention  on  linear  systems  in  locally  compact  abelian  groups  and 
obtained  a  generalization  of  the  classical  results  of  Foures  and  Segal. 
With  the  work  of  these  latter  authors,  the  study  of  causality  assumes 
a  more  general  character.  This  is  marked  by  two  basic  features: 
association  of  the  concept  of  causality  with  other  system  theoretic 
concepts  such  as  passivity,  dissipativity,  stability,  etc. ,  and  the 
introduction  of  modern  tools  of  functional  analysis. 

Recently  this  new  type  of  approach  has  been  supported  by  a 
number  of  other  authors  [  H  ],  [  42  ],  [  43  ],  [  48  ],  |  60  ].  Here  the 
works  of  Porter,  and  of  Saeks  are  the  most  closely  related  to  the 
present  study  and  will  be  a  subject  of  attention  later  in  this  development. 


2.  CAUSALITY  ON  GROUP  RESOLUTION  SPACE 


2. 1  Introduction 

The  development  of  this  chapter  can  perhaps  be  best  introduced 
by  a  brief  discussion  of  some  relevant  work  of  Saeks  [  48  ]. 

Saeks  models  a  system  by  t)ie  use  of  an  axiomatic  structure  called- 
Hilbert  resolution  space.  In  this  context  he  defines  and  studies  various 
classes  of  systems  with  special  causality  related  properties. 

These  classes  consist  basically  of  causal,  anticausal  and  memoryless 
systems.  In  heuristic  terms  a  memoryless  system  has  the  property 
that  the  present  of  the  output  is  only  affected  by  the  present  of  the 
input.  An  anticausal  system  is  characterized  by  the  property  that  it 
becomes  causal  if  we  reverse  the  direction  in  which  the  time  flows. 

To  categorize  the  causality  structure  of  a  linear  system,  Saeks 
offers  a  canonical  causality  decomposition  theorem.  This  theorem 

states  that  every  linear  system  (on  a  Hilbert  resolution  space)  can  be 
decomposed  into  the  sum  of  causal,  anticausal  and  memoryless  systems. 
At  this  point  one  begins  to  envision  a  reasonable  approach  to  the  causa¬ 
lity  problem:  to  start  by  defining  and  studying  a  set  of  ’’basic”  systems 
with  a  particular  causality  character;  and  then  to  investigate  whether 
a  general  system  can  be  decomposed  into  the  combination  of  basic 
systems.  Indeed,  these  two  steps  are  precisely  the  core  of  Saeks’ 
development. 
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It  may  thus  appear  as  if  the  causality  problem  has  been 
exhausted.  To  show  thi  t  this  is  not  the  case  we  introduce  the  fol¬ 
lowing  observitions:  a)  the  statement  of  the  canonical  causality 
decomposition  theorem,  even  in  the  limited  form  in  which  it  has 
been  presented,  is  not,  in  general,  valid  (a  proof  of  this  fact  is  given 
in  Section  4.7) ;  b)  the  classes  of  causal,  anticausal  and  memoryless 
systems  appear  unable  to  account  for  the  causality  behavior  of  simple 
nonlinear  systems  in  communication  and  control  theory;  c)  the  mathe¬ 
matical  model  proposed  by  Saeks  limits  the  scope  of  his  results  to  a 
very  restricted  class  of  systems.  This  model  canr-ot,  for  example, 
be  used  to  discuss  causality  concepts  in  relation  to  even  the  most 
elementary  sequential  machine. 

A  close  examination  reveals  that  the  causality  pi  oblem  is  far 
from  being  solved.  Two  fundamental  questions  which  seem  to  charac¬ 
terize  this  problem  are  the  following:  under  what  circumstances  is  it 
possible  to  decompose  a  system  into  xho  sum  of  basic  systems  with  a 
well  understood  causality  siructure?  What  properties  should  a  system 
have  in  order  to  be  considered  basic  ? 

In  the  present  chapter  we  address  our  efforts  to  the  investigation 
of  the  above  two  questions.  Clearly  a  first  order  of  business  is  the 
formulation  of  a  mathematical  model  to  represent  the  systems  under 
consideration.  In  this  regard  a  setting  called  group  resolution  space 
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is  developed.  Among  the  various  advantages  provided  by  the  group 
resolution  space  setting  the  most  important  are  the  following:  i)  it 
allows  a  meaningful  development ..  ^.ausality  which  is  general  enough 
for  modeling  most  system  problems  in  information,  automatic  control 
and  automata  theory;  U)  it  is  minimal  in  the  sense  that  every  element 
of  this  mathematical  setting  appears  to  be  essential  for  a  reasonable 
development  of  causality  to  be  carried  out;  iii)  it  permits  other 
systenx  theoretic  concepts  (such  as  state)  to  be  analyzed. 

At  this  point  an  overview  of  the  chapter  may  be  in  order.  Section 
2  deals  with  some  necessary  mathematical  preliminaries,  in  particular 
the  characterization  of  group  resolution  spaces.  In  Section  3  we  give 
the  definitions  of  basic  causality  concepts.  Some  properties  of  these 
concepts  are  studied  in  Sections  4  and  5.  Section  6  considers  the 
question  of  causality  canonical  decomposition.  In  Section  7  the  results 
of  the  previous  sections  are  revisited  to  treat  the  case  of  weakly 
additive  systems.  Finally,  Section  8  gives  some  conclusive  remarks. 

2. 2  Group  Resolution  Spaces  (GRS) 

In  this  section  we  introduce  the  mathematical  setting  of  group 
resolution  spaces  on  which  much  of  the  present  causality  study  will 
be  based. 

To  start,  recall  that  an  abelian  group  (in  the  sequel  simply  a 
group)  is  a  set  G  together  with  a  binary  operation  (x,  y)  ->xy  mapping 
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G  X  G  G  such  that  the  following  conditions  are  satisfied: 

i)  x(yz)  =  (xy)  z  for  all  x,  y,  z  €  G  (associative  law) 

ii)  there  exists  an  element  e  €  G  such  that  ex  =  x  for  all 

X  6  G  (e  is  the  identity  element) 

-1  -1 

iii)  for  all  a  6  G  there  exists  a  e  G  such  that  a  a  =  e 
(a”^  is  called  the  left  inverse  of  a) 

iv)  ab  =  ba  for  all  a,  b  e  G. 

A  set  1/  is  linearly  ordered  if  it  is  equipped  with  a  relation  con¬ 
tained  in  the  Cartesian  product  vx  u,  such  that  for  all  t,  s,  t  e  u,  the 
following  conditions  are  satisfied: 

i)  t  <  t  (reflexive) 

ii)  t  <  s  and  s  <  t  imply  t  =  s  (antisymmetric) 

iii)  t  <  s  and  s  <t  imply  t  <  t  (transitive) 

iv)  t,T€  V,  implies  t  <  or  r  <  t  (trichotomy) . 

Given  a  (abelian)  group  G  and  a  linearly  ordered  set  u  the  space 
S[G,  u]  is  defined  as  follows:  if  xeS[G,  p]  then,  to  every  tei^,  x  asso¬ 
ciates  a  well  defined  element  x(t)  eG.  In  other  words  we  have: 

S[  G,  v]  =  {x  |x  is  a  mapping  v  G}. 

The  space  S[ G,  v]  comes  equipped  with  a  family  of  truncation 
operators  p\  P^.  These  operators  P^,  P.  act  on  S[  G,  v]  as  follows: 
if  X.  y,z  belong  to  S[G,  i^]  and  y  =  pV,  z  =  P^x,  then 
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y(s)  =  x(a)  for  s  <  t,  y(8)  =  <f>  otherwise,  and 

z{8)  =  x(8)  for  s  >  t,  z(s)  =  0  otjierwisG 

where  the  symbol  <l>  indicates  the  null  element  cf  G.  The  space  S[  G,  v] 

together  with  the  family  of  truncation  operators  will  be  called  a  group 

resolution  space  (in  short  GRS) . 

In  the  sequel  we  will  alro  use  an  additional  family  of  operators 

dP(t) :  S[  G,v  ]  ->  S[  G,  i/] .  This  family  is  defmed  as  follows:  if  x  and 

y  belot^  to  S[  G,  v]  and  y  -  dP(t)x,  then  y(s)  =  x(s)  if  s  =  t  and  y(s)  =  </> 

otherwise.  Clearly  dP(t)  =  =  P^^P^*  Po*  l^ter  use  we  denote 

-t  - 

by  P  and  P^  the  operators: 

P*  =  P*  -  dP(t)  and  P^  =  P^  •  dP(t) 

-t  — 

Occasionally  dP(t)x,  P  x  jmd  P^x  are  referred  ;o  respectively  as 
present,  past  and  future  of  x  at  time  t. 

To  gain  some  familiarity  with  the  above  dt^finitions  and  to  pro¬ 
vide  some  background  for  later  considerations  ’  ?e  introduce  the 
following  simple  examples. 

Example  1.  Let  r”  be  the  usual  Euclidean  spac  ^  with  dimension  n. 
Every  element  x  in  R*'  is  given  by  an  n-tuple  of  ..eal  numbers 
X  -  (x  j,  X2,  • . . ,  x^)  and  it  can  be  viewed  as  a  fun-  tion  mapping  the 
set  of  integers  {l,  2, . . . ,  11}  into  the  set  of  real  t  imbers  R. 
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Consider  the  set  i/  =  { 1, 2, . . . ,  n}  to  be  equipped  with  the  natural 

order,  and  the  set  G  =  R  to  be  equipped  with  the  familiar  nbtion  of 

addition.  Clearly  i/  is  a  linearly  ordered  set,  G  is  a  group  and  we  can 

li 

then  talk  about  the  group  resolution  space  R  =  S[  G,  i/] . 

The  various  families  of  truncation  operators  are  defined  as 
follows-  ifx=  (Xj,  y=  (yi,...,yn),  w,=  ( w^, . . .  ,Wj^)  and 

I 

z  =  (Xj, . . . ,  z^)  are  elements  cf  S['G,  i/]  then  the  relations 
y  =  P^x,  w  =  P.x,  z  =  dP(j)x  j  e  {l,  2, . . , ,  nj 

I 

imply  the  following 

I 

y.  =  X.  for  j  <  i  and  y.  =  0  for  i  >  i 

li  ~  1  , 

w^  -  0  for  j  <  i  and  Wj  =  x.  for  i  >  j 


z.  -  X.  for ,  j  =  i  and  z.  =  0  for  i  i. 

11'’  i 


Example  2.  Denote  by  [  0,  cc)  the  set  of  positive  real  numbersi  and  by 

t  I 

R  the  set  of  all  real  number.^. 

If  we  consider  the  elements  in  [  0 ,  oo)  to  be  ordered  in  the 
natural  way  and  th^'  set  R  to  be  again  equipped  with  the  uiual  notion 
of  addition,  then  we  can  view  [0,00)  as ,3  linearly  ordered  set  and  R 
as  a  group.  Using  the  notation  v  -  f  0, 00)  and  G  R,  we  can  then 
consider  the  group  resolilition  space 


S[ G,  t']  {x  jx  is  a  function  mapping  f  0, 00)  into  R}. 
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The  various  families  of  truncation  operators  are 
now  defined  as  follows:  if  x,  y,  w,  z  e  S[  G,  v]  and 

y  =  P*x,  w  =  P^x,  z  =  dP(t)x,  t  €  [  0,  ao) 

then  we  have  the  followii^  relations 

y(s)  =  x(s)  for  s  <t,  y(3)  =  Ofor  s  >t 

w(s)  =0  for  s  <  t,  w(s)  =  x(s)  for  s  >  t 

z(s)  =  x(s)  for  s  =  t  and  z(s)  =0  for  s  ^  t. 


A  GRS  can  be  easily  given  a  group  structure.  To  this  purpose 

the  addition  o£  two  elements  is  defined  as  follows;  if  x,  y,  z  e  S[  G,  v] 

then  z  is  the  addition  of  x  and  y,  z  =  x  +  y,  when  z(s)  =  x(s)  +  y(s) 

for  all  8€  u.  Similarly  z  is  the  difference  between  x  and  y,  z  =  x  -  y 

if  y(s)  -  x(s)  =  z(s) .  For  later  use  it  is  observed  that  by  virtue  of 

these  definitions,  any  element  x  e  S[  G,  i;]  can  be  represented  as 

follows:  X  =  21  dP(t)x.  Similarly  pV.  and  P^x  can  be  represented  by 
tev 

P^x=  21  dP(s)x,  P.x=  21  dP(s)x. 
s<t  s>t 

Consider  now  operators  T,  T',  T”  ali  mapping  Sf  G,  v]  ->  S[  G,  u] . 
The  operator  T  is  the  addition  of  T'  and  T",  T  =  T'  +  T",if  for  every 
X  c  3[  G,  t'j  the  following  relation  holds:  Tx  -  T’x  +  T"x.  T  is  the 
difference  between  T'  md  T",  T  =  T’  -  T",  d  Tx  -  T'x  -  T"x.  T  is 
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the  composition  of  T'  and  T",  T  -  T'T"  is  for  every  x  e  S[  G,  i']  the 
following  relation  holds:  Tx  =  T’(T”x) . 

An  operator  T  on  a  GRS  is  unbiased  if  T[0]  =  ^  where  <l>  indicates 
the  element  x  in  S[  G,  v]  such  that  x(s)  =  ^  (the  null  element  ip  G)  for 
all  s  e  1/.  In  the  sequel  only  unbiased  operators  will  be  considered. 
This  is  not  a  serious  limitation.  If  T  is  not  unbiased,  the  development 
will  still  be  valid  for  the  operator  T  -  T[0] . 

2. 3  Causality  Concepts  in  GRS 

In  this  section  we  introduce  and  discuss  some  basic  concepts 
related  to  causality.  The  notation  T  is  used  to  indicate  an  operator 
(unbiased)  on  Sf  G,  v]  and  x  and  y  indicate  two  elements  in  S[  G,  v] . 

Definition  1.  T  is  causal  (aiiticausal)  if  P^x  =  pV  implies  P^Tx  =  P*^Ty 
(P^x  =  P^y  implies  P^Tx  =  P^Ty) . 

Definition  2.  T  is  memory  less  if  it  is  simultaneously  causal  and 
anticausal. 

Definition  3.  T  is  strongly  causal  (strongly  anticausal)  if  T  is  causal 
(anticausal)  and  TdP(t)  x  =  <^. 

Definition  4.  T  is  strictly  causal  (strictly  anticausal)  if  P^x  =  pV 
implies  P^Tx  =  pS>  (P^x  =  P^y  implies  P^Tx  =  PfTy) . 

Definition  5.  T  is  crosscausal  if  TdP(t)x  =  (f>;  P^x  =  (f)  implies 
P^Tx  =  <f)  and  P^x  =  0  implies  P^Tx  =  (f>. 
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Definition  6.  T  is  strongly  crosscaasal  if  P*x  =  ^  implies  ^ 

and  P^x  =  ^  implies  P^Tx  = 

The  concepts  of  causal,  anticausal,  and  memoryless  systems 
are  in  formal  agreement  with  those  proposed  by  Porter  [42],  [43  ] 
and  Saeks  [  48  ] .  It  will  be  apparent  later  that  this  agreement  extends 
also  to  the  concepts  of  strictly  causal  and  strictly  anticausal  systems. 

The  concepts  of  crosscausality  and  strong  causality  find  no 
corresponctence  in  previous  work  of  other  authors.  It  will  become 
clear  with  the  unfolding  of  the  present  development,  that  these  con¬ 
cepts  are  essential  for  the  study  of  the  causality  structure  of  nonlinear 
systems.  In  Section  7  it  is  shown  that  m  the  case  of  additive  systems 
the  concept  of  crosscausality  vanishes  and  strong  causality  coincides 
with  strict  causality.  This  explains  in  part  the  absence  of  these 
concepts  in  the  classical  literature. 

The  attention  of  the  reader  is  called  to  the  fact  that  in  definitions 
1-6  the  domain  of  the  operator  T  is  assumed  to  be  the  whole  space 
S[  G,  v] .  When  the  operator  T  is  defined  only  on  a  particular  subset 
E  of  S[G,  t']  the  concepts  of  causal,  anticausal,  and  memoryless 
systems  can  be  easily  extended.  In  Definition  1  for  example,  it  would 
be  sufficient  to  add  the  sentence  "for  all  x  and  y  in  E”. 

To  extend  the  concepts  of  crosscausality,  strong  causality,  and 
strict  causality  appropriate  and  less  evident  modifications  are  required. 
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Usually  these  modifications  must  be  varied  in  order  to  suit  each 
specific  situation.  This  is  a  rather  serious  limitation  and  will  again 
present  itself  when  the  question  of  canonical  causality  decomposition 
is  considered.  This  limitation  should  be  viewed  as  the  price  being 
paid  to  the  inevitable  compromise:  to  obtain  a  development  which  is 
restricted  enough  as  to  lead  to  meaningful  results  and  which  at  the 
same  time  is  general  enough  as  to  provide  ground  for  further  inves- 
t^ation  when  these  results  are  not  directly  applicable. 

In  the  sequel  it  will  be  helpful  to  refer  to  the  causality  related 
concepts  through  an  alphabetic  code.  For  this  purpose  the  following 
shorthand  notations  will  be  adopted. 

A  =  anticausal  X  =  crosscausal 

C  -  causal  X  =  strongly  crosscausal 

M  =  memory  less  A  =  strongly  anticausal 

A  =  strictly  anticausal  C  =  strongly  crosscaus  il 

C  =  strictly  causal 

The  alphabet  =  {A,C,M,X,  A,C,X,  A,C}  will  be  used  extensively 
and  in  various  ways.  On  some  occasions,  for  instance,  a  sentence  oi 
the  type  "the  operator  T  is  either  causal,  or  anticausal,  or  memoryless" 
is  abbreviated  as  follows  "the  operator  T  is  o  e  (C,  A,  m}.  On  other 
occasions  to  remind  the  reader  of  the  causality  character  of  the  operator 
T,  the  symbols  T^,  T^,  Tj^  are  used. 

As  an  illustration  of  the  notational  convenience  provided  by  the 
proposed  causality  alphabetic  code,  it  is  helpful  to  consider  the 
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statement  of  the  foi'owing  principle  of  causal  duality*:  *'Let  a  statement 
or  equality  be  phrased  usii^  relations  involving  concepts  associated  to 
the  alphabet  A  =  {A,  C,  M, X,  ^  C,X,  A,  ^  and  families  of  truncation 
operators  such  as  {P*,  P^,  P*",  P^}.  Then  the  statement  or  equality 
remains  valid  if  tba  following  interchange  in  symbols  occurs; 

P*  ->  P^,  P^  ->  P^,  P^  ->  P*,  P^  ->  P* 

C->A,  0->4  A->C,  A->C 

C-»A,  A->C,  X->X,  X->X. 

At  this  point  the  formulation  aspect  of  this  study  has  been  laid 
down  and  the  above  machinery  can  be  used  to  answer  some  of  the  basic 
questions  of  interest.  First,  to  gain  some  familiarity  with  the  various 
concepts  it  is  helpful  to  discu.ss  a  simple  example. 

Example  1.  Consider  the  GRS  described  in  Example  2. 1.  Every 
element  x  in  this  GRS  is  given  by  a  function  x(> )  mapping  e  very 
t  e  [0,oo)  into  an  element  x(t)  e  R.  Consider  the  operator  T  defined 
as  follows:  if  y^  x  e  S[  G,  v]  and  y  =  Tx  then 

y(t)  =  X(t  +  Tj)x(t  +  Tg) 

where  and  T2  are  real  numbers  and  we  have  used  the  notation 
x(s)  =  0  for  s  <  0 . 

*A  formal  proof  is  omitted  for  brevity.  The  reader  should  have 
no  difficulty  to  verify  by  direct  inspection  that  this  principle  holds  in 
all  future  situations  where  we  invoke  its  validity. 
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The  causality  character  of  T  is  determined  by  the  location  of 
2 

the  point  (tj,  in  the  R  plane.  For  instance,  if  (tj,  coincides 
with  the  origin  then  T  is  memoryless.  When  (tj,  /  (0,0)  various 
situations  can  occur  and  are  illustrated  in  Figure  2. 1. 

In  particular,  if  the  point  (t^,  is  in  the  third  quadrant  then  T 
is,  in  general,  causal.  More  specifically,  if  both  Tj  and  Tg  are  negative 
and  different  from  zero  then  T  is  simultaneously  strictly  causal  and 
strongly  causal;  if  Tj  is  negative  and  Tg  is  equal  to  zero  then  T  is  strongly 
causal  but  not  strictly  causal. 

Similarly  if  the  point  (tj,  is  located  in  the  svjcond  or  fourth 
quadrant  then  T  is,  in  general,  a  crosscausal  operator.  Finally,  if 


Tj  is  positive  and  T2  is  negative  then  T  is  strongly  crosscausal. 


2. 4  Causality  Properties  of  Basic  Systems  in  GRS 

In  this  section  we  elaborate  on  some  meaningful  physical  inter¬ 
pretations  of  the  causality  concepts  formulated  in  Section  2. 3.  This 
will  also  lead  us  to  a  number  of  mathematical  implications  which  will 
play  a  key  role  later  in  the  development. 

To  help  motivate  our  discussion  recall  that,  in  heuristic  terms, 
a  system  T  is  causal  if  the  present  of  the  o”.tput  does  not  depend  on  the 
future  of  the  input.  This  can  be  expressed  by  saying  that  the  past  of 
the  output  is  only  a  function  of  the  past  of  the  input.  This  pioperty  is 
in  turn  equivalent  to  a  special  'sum-type”  representation. 
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1  anticausal,  strongly  anticausal,  strictly  anticausal 

2  crosscausal,  strongly  crosscausal 

3  causal,  strongly  causal,  strictly  causal 

4  crosscausal,  strongly  crosscausal 

5  causal,  anticausal,  n^emoryless 

6  anticausal,  strongly  anticausal,  crosscausal 

7  causal,  strongly  causal,  crosscausal 

Figure  2.1:  Causality  character  of  the  operator  T  as  a  function 
of  (  Tj,  Tg). 
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Proposition  1.  The  followii^  statements  are  equivalent; 

a)  T  is  causal 

b)  P*T  =  P*TP^  for  all  t  € 

c)  T  has  the  following  representation  T  =  ^  dP(s)TP^. 

seu 

Proof,  a)  — >  b) .  SSuppose  that  T  is  causal.  If  b)  is  not  true,  then 
there  exists  an  x  €  S[  G,  i/]  and  tev  such  that  P^Tx  P^TP^x.  If  we 
now  use  the  notation  y  =  P^x,  we  obtain  that  P^x  =  pV  and  P^Tx  ^  P^Ty , 
This  is  a  contradiction  to  the  l^pothesis  that  T  is  causal. 

b)  — >  c) .  If  b)  holds  then  for  every  s  €  y  we  have;  P®T  = 

P®TP®  and  since  dP(s)  =  dP(s)  P®  we  obtain  dP(s)  T  =  dP(s)  TP®. 

Hence  we  can  write  T  =  2]  dF(s)  TP®. 

sev  ^  . 

c)  — >  a) .  Suppose  that  x  and  y  belong  to  S[  G,  u]  and  P  x  =  P  y. 

Since  P*dP(s)  =  </>  when  t  <  s,  then  if  c)  holds  we  can  write 

P*Ty-  21  dI'(s)TP®x. 
s<t 

But  for  s  <  t  we  have  P®P^  =  P®.  It  follows 

P^Tx=  y  dP(s)TP®P*x  -  Yj  dP(s)TP®pV- P^.  <C] 

s<t  s<t 

Using  techniques  similar  to  those  adopted  above,  we  obtain  the 
next  proposition.  This  proposition  states  that  a  memoryless  system 
is  characterized  by  the  property  that  past  or  future  of  the  output  are  a 
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function  of,  respectively,  only  the  past  or  the  future  of  the  input.  In 
other  words,  ';he  present  of  the  output  is  determined  only  by  the  present 
of  the  input.  This  property  can  a;@o  be  put  into  a  1-1  corre^ndence 
with  a  special  *'sum-type*'  repress*  ntation. 

Proposition  2.  The  following  staterients  are  equivalent 

a)  T  is  memory icss 

b)  P*T  =  P*TP*  and  P^T  =  P^Ti>^ 

c)  T=  2  dP(s)TdP(s). 

sev 

A  meaningful  physical  interpretation  can  also  be  assigned  to  the 
concepts  of  strong  and  strict  causality.  In  particular,  a  strongly 
causal  system  Is  a  causal  system  with  the  property  that  the  present 
of  the  input  caimot  affect  the  present  of  the  output  when  the  past  of  the 
input  is  null.  The  behavior  of  a  strictly  causal  system  satisfies  a  more 
severe  requirement.  In  addition  to  being  causal  this  type  of  system 
has  the  property  that  the  present  of  the  input  can  in  no  way  affect  the 
present  of  the  output.  These  considerations  are  formalized  and  made 
more  precise  by  the  following  Propositions  3  and  4. 

Proposition  3,  The  following  statements  are  equivalent: 

a)  T  is  strongly  causal 

b)  P^T  =  P^P^  and  dP(t)  TdP(t)  =  <t> 

c.)  T  is  causal  and  Yj  dP(s)  TdP(s)  =  (j). 

sev 
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Pro^.  a)  b) ,  In  view  of  Proposition  1,  all  we  have  to  show  is 
that  dP(t)  TdP(t)  =  <l>.  Indeed  from  P^T  =  P^TP^  it  follows  P^T  =  P^TP^ 
and  from  here  we  obtain 

p’^TdP(t)  =  (P^  +  dP(t))TdP(t)  -  ^TdP{t)  +  dP(t)Tdp(t) 

=  P*TP^dP(t)  +  dP(t)TdP(t)  =  dP(t)TdP{t). 

This  implies  that  if  TdP(l)  =  <{>  then  v/e  also  must  have  dP(t)  TdP(t)  =  0. 

b)  — >  c) .  If  b)  is  true  then,  from  Proposition  1,  T  is  causal. 

Moreover,  since  we  must  have  dP(s)  TdP(s)  =  0  for  every  2  e  v  then  it 

follows  that  we  must  also  have  J  dP(s)  TdP(s)  =  0. 

sev 

c)  a) .  If  c)  holds  then  T  is  causal  and  we  must  have 
dP(t)  TdP(t)  =  0.  This  implies  that  P*TdP(t)  =  0  and  T  must  then  be 
strongly  causal. 

Proposition  4.  The  following  statements  are  equivalent: 

a)  T  is  strictly  causal 

b)  P*T  =  pVp* 

c)  T=  2  dP(s)TP®and  dP(s)TdP(s)  =0. 

se  sei/ 

Proof,  a)  b) .  If  b)  is  not  true  then  we  can  find  a  pair  x,  y  e  S[  G, !  j 
such  that  P*x  =  P^  and  P^Tx  P*Ty.  This  is  a  contradiction  to  a) . 
b)  — >  c) .  If  b)  holds  then  for  every  t  e  we  have 

dP(t)  T  =  dP(t)  P*T  =  dP{t)  pHp^  =  dP(t)  TP^ 
dP(t)  TdP(t)  =  dP(t)  TP*dP(t)  =  0. 


and 
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From  here  it  follows  that 


T=  J  dP(s)T=  ]]  dP(s)TP®and  J  dP(s) TdP(s)  =  0. 
sev  aev  aev 

c)  — >  a) .  Suppose  that  c)  holds,  and  let  x,  y  e  S[G,  v]  be  such 

that  P^x  =  pV‘  Then  we  have 


P*Tx=  y  dP(s)TP®x=  Yj  dP(s)TpVx 
s<t  s<t 

=  Yj  dP(s)TP^V  =P^Ty. 
s<t 

We  can  then  conclude  that  T  is  strictly  causal. 


The  causality  behavior  of  a  crosscausal  system  has  a  physical 
interpretation  which  is  similar  to  those  seen  in  the  case  of  causal, 
anticausal  or  memoryless  systems.  In  this  case  the  past  or  the  future 
of  the  output  are  null  whenever,  respectively,  past  or  future  of  the  input 
are  null.  Moreover,  if  past  and  future  of  the  input  are  simultaneously 
null  then  the  present  of  the  input  has  no  effect  on  the  output. 

Analogously,  a  strongly  crosscausal  system  is  a  crosscausal 
system  with  the  additional  property  that  the  present  of  the  output  is 
null  whenever  the  past  or  the  future  of  the  input  is  null. 

To  further  illustrate  the  nature  of  this  type  of  system  we  introduce 


Propositions  5  and  6. 
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Proposition  5.  The  following  statements  are  equivalent: 

a)  T  is  crosscausal 

b)  TP*  =  P*TP*,  TPj  =  PjTPj  and  TdP(t)  =  if 

c)  XdP(s)TP®=  ^  dP(E)TdP(s)  =0. 

S€v  sei/  sev 

Proof,  a)  — >  b) .  Suppose  that  T  is  crosscausal.  If  TP  #  P  TP 

then  there  exists  an  element  x  e  S[G,  v]  such  that  TP^x  =?  P^TP^x. 

Using  P^  =  I  -  Pj  we  have  P^TP^  =  TP^  -  P^TP'^  and  hence  from  the 

above  inequality  P^TP^x  ^  (\>  holds.  Letting  y  =  P^\  we  have 

P^Ty  =  <!>  and  P^y  =  0 

Since,  by  hypothesis,  T  is  crosscausal  this  is  impossible  and  we 
_t  -t  — t 

must  then  liave  TP  =  P  TP  .  Invoking  the  principle  ol  causal  duality 
we  also  obtain  Pj.T  =  P^TP^*.  Finally  suppose  TdP(t)  ^  0.  Then 
there  exists  an  element  x  e  S[G,  u]  such  that,  TdP(t)  x  0.  This 
is  again  a  contradiction  to  a) . 

b)  ->  c) .  Suppose  that  b)  holds,  then  we  have 

TP®  =  P®TP®  and  TP  =  P  TP 

S  S 

From  these  relations  and  the  fact  that  TdP{s)  -  0  we  obtain 
TdP(s)  =  0  =  P®TdP(s)  +  dP(s)  TdP(s)  +  P^TdP(s) 

♦For  a  direct  proof  the  reader  is  invited  to  apply  the  change  in 
symbols  indicated  by  the  principle  of  causal  du^itvand  to  repeat 
"verbatim”  the  argument  used  to  obtain  TP^  -  ^TP  . 


29 


It  .follows 


4>  =  P®TP  dP(s)  +dP(s)TdP(s)  +  P  TP®dP(s) 
s  s 

^  p’p  TP  dP(s)  +  P  P®TP®dP(s)  +  dP(s)  TdP(s) 
s  s  s 

dP(s)TdP(s)  =  <f> 

and  consequently 


2  dP(s)  TdP(s)  =  <l>, 

8€V 

Moreover,  using  the  fact  that  dP(s)  P®  =  dP(s)  P  =  <;>  we  obtain 

s 

J  dP(s)TP®=  2  dP(s)  P®TP®  =  <^ 
aeu  seu 


and 


I  dP(s)TP  =  I  (tP(s)PgTP 
S£<^  sev 

We  can  then  conclude  that  c)  holds. 

c)  — >  a) .  Suppose  that  c)  holds.  For  every  x  e  S[  G,  u]  v/e  have 

TdP(t)x=  2  dP(s)TdP(t)x 
se.v 


=  y  dP(s)TdP(t)x  +  dP(t)TdP(t)x 
s<t 


2  dP(s)TdP(t)x. 
}>t 


Noting  that  P  dP(t)  =  dP(t)  for  s  <t,  P®dP(t)  -  dP(t)  for  s  >t, 
s 

dP(t)dP(s)  =  dP(t)  for  s  =  t  and  dP(t)  dP(s)  =  <f>  ior  s  ^  t,  we  obtain 
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t  \ 

TdP(t)x=  2  dP(s)TP^dr(t)x  +  V  dP(s)TP^dP(s)x  + 
s<t  ®  s>t 

dP(t)  Y,  TdP(s)  dP(t)  X  =  <^. 
sev 

Moreover  if  P^x  =  <t>,  then  we  also  have 

P,Tx=  P,  y  dP(s)TE^x  =  y  dP(s)TPVx  =  <#». 

^  s>l  s>t' 

From  the  above  and  the  principle  of  causal  duality  it  follows  that 
pV  =  0  implies  P^Ty  =  0.  It-  can  then  be  concluded  that  T  is  cress- 
causal.  ^ 

Proposition  6.  The  followir^  statements  are  equivalent: 

a)  '  T  is  strorigly  crosscausal 

b)  TP^  '=  P*TP^  and  TP^  =  P^TP^ 

c)  2  dP(s)TP®=  2<^P(s)TPg=  2;  <*P(s)TdP(s)  =  0 

se^•  i  set'  Sfu 

Proof,  a)  — >  b) .  Suppose  that  a)  holds.  If  TP^  *  5p*TP*,  then  there  , 

exists  an  X  e  Sf  G,  u]  such  that  TP^x  *  P^TP^x.  This  implies  P^.TP^x  t  (/>. 

Using  the  notation  P^x  =  y  we  then  obtain  that  P^y  -  <f)  and  P^-Ty  </».  This 

t  — t  t 

is  a  contradiction  to  a) .  We  must  then  have  TP  =  P  TP  .  Invoking  the 
principle  of  causal  duality  this  argument  gives  also  TP^  =  P^-TP^.. 
b)  c) .  If  b)  holds  then  for  each  t  e  t*  we  must  have 

dP(t)  Tp‘  =  dP(t)  P^TP^  =  0,  dP(t)  TP^  =  dP(t)  P^TP^  -  <j> 
and 

dP(t)TdP(t)  =  dP(t)  pSdP(t)  ^  0. 
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It  follows 

J  dP(s)TP®=  X  dP(8)TPg-  Y.  dP(8)TdP(s)  =<fr. 

S€i/  aev  SCI/ 

c)  a) .  Suppose  that  c)  is  true.  Then  for  every  x  c  S[G,  i/j 
such  that  P^x  =  4>  we  must  have 

P.Tx=  y  dP(8)TP*x=  y  dP(s)TpVx= 

*  s>t  s>t 

By  the  principle  of  causal  duality  this  also  says  that  if  y  c  S[G,  i/]  and 
P^y  =  <f>  then  P*Ty  =  It  can  then  be  concluded  that  T  is  strongly  cross- 
causal. 

2.  5  Causality  and  the  Composition  of  Systems  in  GRS 

In  this  section  we  continue  our  investigation  on  some  causality 
related  aspects  and  properties.  In  particular  Propositions  1-5 
illustrate  some  properties  connected  with  the  addition  and  composition 
of  systems  with  a  special  causality  structure.  Two  disjointedness 
properties  of  these  systems  are  given  in  Propositions  6  and  7. 

In  most  nontrivial  applications,  basic  subsystems  are  combined 
through  the  operations  of  addition  and  composition.  A  first  natural 
question  then  is  whether  the  class  of  systems  which  are 
a  €  {A,  C,  M,  X,  A,  C,X,  A,c}  is  closed  under  such  operations.  The 
following  proposition  shows  that  the  answer  to  this  question  is 


affirmative. 


A 


Proposition  1.  K  T  and  T’ are  ac  {A,C,B«,X,^C^,  A,Q  then 
T  +  T'  and  TT*  are  also  a. 

Proof.  In  view  of  the  similarity  amoi^  the  various  cases,  we  will 
only  consider  of  =  C  and  a  =  X.  Suppose  then  that  T  and  T’  are  C. 
From  Proposition  4. 1  we  have 

P*T  =  P*TP^  and  P*T*  =  P^T'P^. 

From  here  we  obtain 

P*(T  +  T')  =  P^T  +  P*T’  =  P*TP^  +  p^T’P^  =  P^T  +  T’) 

P^TT’  =  P^Tp4  ’  =  pVpV'P^  =  pVt’pV 

Applying  again  Proposition  4. 1  it  follows  that  T  +  T’  and  TT'  are  C. 
Suppose  now  that  T  and  T’  are  X.  From  Proposition  4. 6  we  have 
TP*  =  P*TP*  and  TP*  =  P^TP^. 

This  implii's 

(T  +  T')  P*  =  TP*  +  T’?*  =  P*TP*  +  P*T'P*  =  P*(T  +  T')  P* 
and  by  the  principle  of  causal  duality 

(•r.r)Pj=p,(T  +  T')Pt. 

By  Proposition  4.  6  it  'ollows  that  T  +  T'  is  strongly  crosscausal. 
Similarly  for  TT'  we  have 

TT'P*  =  TP*T’P*  =  P*TP*T’P*  -  P^TT’P^ 

TT'Pj  =  TP^T'Pj  =  P^TPjT'P^  =  P^TT’Pt 


and  consequently  TT'  is  also  strongly  crosscausal. 
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The  causality  properties  of  a  ^stein  g^ven  by  the  composition 
of  iqrstems  with  diverse  causality  structures  can  usually  be  determined 
only  by  a  case  by  case  analysis.  Under  ^cial  circumstances  seme 
general  statements  are,  however,  possible.  The  next  proposition, 
for  instance,  indicates  that  whenever  a  system  T  is  composed  with  a 
memoryless  system  T'  then  the  causality  character  of  TT'  and  T'T 
coincides  with  that  of  T. 

Proposition  2.  If  T  is  mcmoryless  and  T’  is  a  e  {A,  C,  M,  X,  A,  C,  X,  A,C  } 
then  TT*  and  T'T  are  also  a. 


Proof.  This  proof  follows  a  pattern  which  is  similar  for  the  various 
choices  of  a.  It  will  then  be  sufficient  to  treat  the  case  in  which  T*  is 
X.  From  Propositions  2  and  6  we  obtain  the  following  relations 

pV  =  P^TP*  and  P^T  =  PtTP^ 

T'P‘  .  p‘t'p‘  and  T'P^  =  PjT’Pj. 


From  here  we  also  obtain 


TP*  =  P*TP*  +  P^TP*  =  P*TP*  +  P^TP^P*  =  P*TP* 

TP^  =  PjTPj  +  P*TPj  =  PjTP^  +  P*TP*Pj  - 


TT'P*  =  TP*T'P*  =  P*TP*T’P*  =  P*TT*P* 


TT’P^  =  TP^T’P^  =  P^TP^T’P^  -  P^TT'P^ 


It  then  follows  that 
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aud  similarly, 


T*TP 


=  pS-tp* 


TTPj  =  P^T’TP^- 

Froiii  these  relations  and  Proposition  4. 6  we  can  conclude  that  TT* 
and  T'T  are  indeed  X.  ^ 


The  next  Propositions  3, 4  and  5  illustrate  an  interesting  repro¬ 
ducing  property  of  strongly  causal,  strictly  causal  and  strongly  cross- 
causal  ^sterns.  According  to  this  property,  the  classes  of  strictly 
causal  and  strongly  causal  systems  can  be  viewed  as  a  "symmetric 
ideal"  in  the  class  of  causal  systems.  Similarly  the  class  of  strongly 
crosscausal  systems  can  be  viewed  as  a  symmetric  ideal  in  the  larger 
class  of  crosscausal  systems.  For  brevity  we  will  only  prove  Propo¬ 
sition  3. 


Proposition  3.  If  T  is  strongly  causal  and  T'  is  causal  then  TT'  and 
T'T  are  also  strongly  causal. 

Proof.  From  Proposition  4. 1  and  4. 3  we  have  the  following  relations 

P^T  -  P^TP*  and  dP{t)  TdP(t)  =  cp 
P^T'  =  P^T'P^. 


These  relations  also  imply 


TP^  =  PjTT^  and  T'?^  =  P^T'P^. 
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It  follows 


P^TT'  =  P^TP^T*  =  P^TP^T'P^  =  P^TT'P^ 


and  similarly 


ptj..T  =  P*T*TP^ 


Bforeover, 

dP(t)TT’dP(t)  =  dP(t)TP*P^T’dP(t)  =  dP(t)  TdP(t)  TdP(t)  =  ij> 
and  consequently 

dP(t)T'TdP(t)  = 

From  the  above  relations  and  Proposition  4>  3  we  can  then  conclude 
that  T'T  and  TT*  are  strongly  causal. 

Proposition  4.  If  T  is  strictly  causal  and  T'  is  causal  then  TT’  and 
T'T  are  also  strictly  causal. 

Proposition  5.  If  T  is  strongly  crosscausal  and  T’  is  crosscausal  then 
TT'  and  T'T  are  strongly  crosscausal. 

To  conclude  our  review  of  causality  properties,  we  observe  that 
the  various  causality  classes  under  consideration  are,  in  general, 
overlapping.  For  example  a  memoryless  system  is  also  causal  and 
anticausal.  Similarly  a  system  which  is  crosscausal  can,  at  the  same 
time,  be  causal  or  anticausal.  The  next  result  shows  that  the  classes 
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of  strongly  causal,  strongly  anticausal,  strongly  crosscausal  and 
memoryless  ^sterns,  however,  are  disjoi'i. 


Proposition  6.  If  T  is  simultaneously  Oj  and  with  oi,  e  ^  M,  x} 

then  either  ai  =  ou  or  T  is  the  null  operator. 

*  ^ 


Proof.  For  the  various  choices  of  and  012  the  arguments  to  be  used 
turn  out  to  be  similar.  It  wiU  be  then  sufficient  to  treat  a  special  case. 
Suppose,  for  instance,  that  T  is  simultaneously  X  and  C.  Then  from 
Propositioas  4. 1  and  4. 6  we  have 


T=  2;  dP(s)TP®and  V  dP(s)  TP®  =  <#». 
sev  sev 

It  follows  that  T  must  be  the  null  operator. 


The  next  result  is  similar  to  Proposition  6  and  states  that  also 
the  classes  of  strictly  causal,  strictly  anticausal,  memoryless  and 
crosscausal  systems  are  disjoint. 

Proposition  7.  If  T  is  simultaneously  and  ^2  with  of^,  Og  ^  { A,  C,  M,  X) 
then  either  =  Og  or  T  is  the  null  operator. 

The  above  discussion  provides  a  clear  picture  of  the  relation  ; 
of  containment  among  the  various  causality  classes.  These  relations 
are  further  illustrated  in  Figure  2.2. 

2. 6  Canonical  Causality  Decomposition  in  GRS 

The  development  in  the  previous  sections  provides  insight  into 
the  causality  structure  of  those  systems  which  are  basic,  that  is 
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I  I 


Figure  2. 2:  Relations  of  containment  among  various  classes 
of  systems. 
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systems  which  are  a  e  {A,  C,  hi, X,  ^  C,  purpose  of  this 

section  is  to  extend  that  insight  to  the  case  of  more  general  systems. 

To  help  motivate  the  development,  observe  that  our  insight  into 
the  causality  structure  of  basic  systems  can  be  readily  used  to  charac¬ 
terize  the  causality  structure  of  those  systems  which  are  formed  by 
the  addition  of  basic  systems.  The  natural  question  then  arises  as  to 
whether  it  is  possible  to  represent  a  general  system  as  the  addition 
of  basic  systems.  If  this  representation  does  exist  it  is  also  of  interest 
to  know  whether  it  is  unique. 

Such  questions  as  those  above  have  been  considered  in  the  techni¬ 
cal  literature  and  are  known  collectively  as  the  canonical  causality 
decomposition  problem  [  48  J .  However,  as  the  systems  considered  in 
[  48  J  are  linear  and  defined  on  a  Hilbert  space  while  our  systems  are 
neither  linear  nor  are  defined  in  a  linear  space,  the  answer  given  in 
[48]  is  of  little  help  to  this  development. 

Concerning  the  matter  of  uniqueness  suppose,  for  example,  that 

T  =  T .  +  T^.  Then  we  can  also  write  T  =  T'  +  T’ ,  where  T'.  =  T .  - 

AC  C  A’  A  A 

Tm*  “  ^C  ~  meraoryless  operator.  This  implies 

that  the  decomposition  of  T  is  not  unique. 

A  moment  of  reflection  shows  that  the  above  argument  is  suc¬ 
cessful  because  the  various  classes  of  basic  systems  are  overlapping. 
On  the  other  hand  we  have  seen  in  Proposition  5, 6  that  the  classes  of 
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systems  ae  {A,C,  M,X}  are  disjoint.  From  here  it  a]^ars  naturai 
to  modify  the  causalify  decomposition  question  with  the  following  more 
specific  formulation:  '*is  it  possible  to  decompose  a  general  system 
into  the  sum  of  ^sterns  which  are  a  e  {A,  C,  M,  X}  ?  If  a  decomposition 
of  this  type  exists  it  will  be  called  a  canonical  causality  decomposition*. 

To  begin  our  study,  we  settle  the  uniqueness  question  with  the 
following  proposition. 

Proposition  1.  If  a  canonical  causality  decomposition  exists  then  it  is 
unique. 

Proof.  Suppose  that  a  system  T  has  two  canonical  decompositions. 

Then  we  can  write 

From  here  it  follows  that 

(1) 

and  since  T^  -  Tj^  is  a  memory  less  operator,  from  Proposition  4.  2 
we  must  have 

Tm-Tm=  2  dP(s)(Tj,-T^)dP(s). 

Sf.V 

This  leads  to  the  following 

♦Note  that  an  alternative  formulation  of  a  causality  decomposition 
is  also  suggested  by  Proposition  5. 7.  While  attention  is  foci^sed  on  the 
{A,  C,  M,  X}  decomposition,  a  decomposition  based  on  {A,  C,  M,  x} 
can  be  handled  with  similar  techniques  and  results. 


"*U 


2  dP(s)(T^- T^)(iP(s)  +  I  dP(s)(T^-Tj,)dP(s) 


+  X  dP(s)(T'  -TJdP(s). 

sev  —  ±- 

Applying  Propositions  4. 3  and  4. 6  we  obtain  that  each  term  on  the 
right  hand  side  of  the  above  equation  is  null.  We  can  then  conclude 

Let  us  now  show  that  Since  -  Tj^  =  0,  Equation 

(1)  leads  to 


Since  is  strongly  causal  we  can  apply  Proposition  4  3  and 

obtain 


I  dP(s){Tp  -  TJ,)P®. 


This  leads  to  the  following 


T„-T'  =  J  dr(s)(T'  -  T.>P®+  2  dP(s)(T'  -T  )P'’ 
--s£i  -  -  set^  -- 

Observe  that  the  second  term  on  the  right  hand  side  of  the  above 

equation  is  null  ay  Proposition  4. 6  and  the  fact  that  T'  -  is  strongly 

crosscausal.  The  first  term  is  also  null  as  can  be  seen  by  using  the 

strong  anticausality  of  T^  -  T^  together  with  the  dual  of  Proposition 

4.3,  namely 
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E 


dP(s)(T^  -  = 


I  dP(s)Pg(T^-T^)P^P® 


=  I  dP(s)  (T).  -  T . )  dP(s)  = 
s«i/  2  * 

We  can  then  conclude  that  =  T^,  and  from  the  principle  of  causal 
duality  =  T^.  Finally  from  Equation  (1)  and  the  fact  that  Tj^  -  Tj^ 

=  =  </),  we  have  =  (/>.  Hence  and 

the  proof  is  complete. 

From  the  above  proposition  if  T  has  the  property  that  T  =  + 

*  Tx  it  is  meaningful  to  talk  about  the  a  component  of  T,  ae  {A,  C,  M,X}. 
In  this  regard  we  will  use  the  following  definition. 

Definition  1.  If  T  =  +  Tj^  +  then  T^,  T^,  and  are 

called  respectively  strong  anticausal,  strongly  causal,  memoryless  and 
strongly  crosscausal  components  of  T. 

In  general  the  question  of  existence  of  a  canonical  decomposition 
can  be  viewed  in  terms  of  the  existence  of  a  special  set  of  mappings  on 
the  space  of  operators.  This  point  of  view  offers  some  technical  advan¬ 
tages  and  it  is  convenient  to  clarify  it. 

To  begin  with,  let  $  indicate  the  space  of  all  operators  T  on  a 
GRS,  andT  an  operator  on  $.  To  emphasize  thatT  maps  a  space 
of  operators  into  itself,  T  is  called  a  transformator*.  A  transformator 


♦This  terminology  is  inspired  from  Gohberg  and  Krein  [2  5  j . 
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will  be  indicated  ,  a  e  {A,  C,  M,  X}  if  for  each  T  €  $  we  have 

thatT*  [rj  is  an  a  operator.  For  example  the  rai^e  of  consists 
of  the  class  of  operators  which  are  X.  Occasionally  we  will  also  use 
the  notation  I  to  indicate  the  identity  transformator,  that  is  the  trans> 
formator  with  the  property  that  I  [t]  =  T  for  every  T  in  $. 

The  following  proposition  shows  the  equivalence  between  exis¬ 
tence  of  a  canonical  decomposition  and  existence  of  a  special  set  of 
transformators. 

Proposition  2.  A  canonical  causality  decomposition  always  exists 

if  and  only  if  there  exists  a  set  of  transformators  T  , 

a€  {a,  C,M,X}  =  fl,  such  that  the  following  properties  are  satisfied: 

pi)  ^  is  defined  on  $ 
a 

2 

pii)  For  each  pair  {a,  y)  e  we  have  that 

T*  T  -  (j)  if  a  /  Y  and  T  "T*  =  TT  if  a  =  y 
ay  '  a  y  a 

p“‘)  Z 

Proof,  ’’only  if".  If  each  T  has  a  causality  cjtnonical  decomposition 
we  can  define  the  transformators TT  according  to  the  following  rule: 
*r  [TJ  =  where  is  the  a  component  of  T.  Then  properties  pi) 

and  phi)  are  clearly  satisfied.  To  prove  pii)  suppose  that*!"  "T* 

a  y 

for  a^  y.  Then  we  can  find  an  operator  T  such  ihat  T  is  a  and  the  y 
component  of  T  is  different  from  zero.  It  woui  '  follow  that  T  has  at 
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least  two  distinct  causality  canonical  decompositions.  This  is  a  con¬ 
tradiction  to  Proposition  1. 

"if”.  &ippose  that  there  exists  a  set  of  transformatorsT  such 
that  pi) ,  pii)  and  piii)  are  satisfied.  Then  for  every  operator  T  e  $ 
we  can  compute  the  operators  T  =  T*  [T],  for  each  a  e  fl  ,  and  from 
piii)  we  can  write 

T  =  T  +  T^  +  Tw  +  Tv. 

This  means  that  T  has  a  causality  canonical  decomposition. 

With  the  above  result  and  the  development  in  Section  4,  it  is  now 
easy  to  state  and  prove  that  a  canonical  causality  decomposition  always 
exists. 

Proposition  3.  Every  system  on  a  GRS  can  be  decomposed  into  the  sum 
of  strongly  causal,  strongly  anticausal,  strongly  crosscausal  and 
memoryless  components. 

Proof.  Suppose  that  T  is  an  operator  on  S[  G,  u]  and  define  a  trans- 
formator  according  to  the  following  rule: 

[T]=  2dP(s)TdP(s). 
scu 

From  Proposition  4.2.  t;;,  [T]  is  a  memoryless  operator.  Define 
now  the  transformators  as  follow... 

X[T]=  V  dP(s)(T-i;,[T]]p“ 
sev 

•r  [T]  =  I  dP(s)[T-T,lTj]P  . 
sev 
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From  Proposition  4. 1  and  its  dual,  [t]  andT^  [T]  are  respectively 
strongly  causal  and  strongly  anticausal.  Finally,  consider  the  trans- 
formator  defined  the  followii^  expression 

Observe  that  the  operator  ^  [  Tj  satisfies  the  relations  in  Proposition 
4. 6.  Hence,  it  is  strongly  crosscausal.  At  this  point  verify  that  the 
above  set  of  transfer matorsT|j|^,T^ 
in  Proposition  2.  It  can  then  be  concluded  that  T  has  a  causality  canoni¬ 
cal  decomposition. 

Combining  Propositions  1  3,  it  is  now  possible  to  state  the 

following  Canonical  Causality  Decomposition  Theorem. 

,  I  :  >  ■ 

Theorem  1.  Every  system  on  a  GRS  has  a  canonical  causality  decom¬ 
position  and  this  decomposition  is  unique.  , 

To  illustrate  the  meaning  of  the  above  result  we  now  pause  to 
discuss  a  simple  example. 

Example  1.  Suppose  that  S[G,  u]  is  described  as  in  Example  2. 1. 

Then  every  element  x  €  ,Sf  G,  u]  is  given  by  an  n-tuple  oi  real  numbers 
(XpXg, . . .  ,x^) .  For  simplicity  we  will  assume  that  n  =  3.  In  this 
GRS  we  can  consider  the  (unbiased)  systeni  T  deiined  as  follows; 
if  X,  y  €  Sf  G,  u]  and  y  =  Tx,  then 


and  satisfies  pi-ii-iii) 


(yj  =  2(x2)  *  ♦  +  5(Xj)  ^ 

^3  "  *1*2  *  ^^*1^  ^  ^  *1*2' 

It  is  easily  verified  that  T  does  not  satisfy  anyone  of  the  require 
ments  in  Definitions  2. 1  >  2. 6.  Therefore  T  is  not  a  basic  system. 
Theorem  1  says,  however,  that  T  can  be  represented  by  the  addition 
of  basic  systems.  If  these  basic  systems  are  chosen  to  be 
a  e  {A,  C,  M,  X}  then  the  repre sentation  is  unique.  In  this  case  we 
can  write 


Moreover  according  to  the  proof  of  Proposition  3,  T^,  T^,  T^^  and 

T^  can  be  computed  by  the  expressions 

3 

T„=  2  dP(i)TdP(i) 

Ta  = 

3 

Tc  =  I 

“  i=l 


’’x  =  '^-^a-Tc- V 


The  meaning  of  these  expressions  is  that  T^,  T^,  Tj^  and  T^  are  des¬ 
cribed  as  follows:  if  x, y  c  S[ G,  v]  and  y  =  Tx,  ate  {A,  C,  M, X}  then 


we  write: 


yj  =  +  SXjXj 

y2=3V2 

73=0 


M  =  <*!>* 

I  ^2  "  ^2* 

U3=<*3>* 

2 

^C'  1^2  ■***!*  '*’x‘ 

\y3=^l*2^^<*l>* 

Often  the  question  of  canonical  causality  decomposition  arises  in 
a  more  complicated  setting  than  the  one  considered  here.  In  general 
the  complications  are  due  to  the  following;  the  operator  T  may  not  be 
defined  over  all  the  GRS;  the  operator  T  may  belong  to  a  particular 
subset  of  $  and  it  is  of  interest  to  determine  whether  a  canonical 
decomposition  exists  such  that  the  components  of  T  belong  to  $2, 
another  sr’'3et  of  $. 

In  both  such  situations  the  statement  of  Proposition  1  remains 
valid.  When  the  domain  of  T  is  a  proper  subset  of  the  GRS  it  is  best 
to  proceed  on  a  case  by  case  basis.  An  illustration  of  the  type  of 
procedures  which  might  be  used  is  given  in  [  42]  and  [48]  where 
operators  T  defined  on  Hilbert  spaces  are  considered.  In  regard  to 
the  second  situation  it  may  be  helpful  to  rephrase  the  result  of  Propo¬ 
sition  1  in  a  slightly  more  convenient  form. 
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Proposition  4.  The  following  statements  are  equivalent; 

a)  Every  operator  T  c  has  a  canonical  decomposition 

T  =  +  Tm  +  with  T^,  T^,  Tj^,  in  Ig. 

b)  There  exists  a  set  of  transformators^^  a  e  {A,  C,  M,  X} 
such  that  the  following  properties  are  satisfied: 

pi)  X  is  defined  over  $j  and  maps  $j  into  $2 
pii)  and  piii)  identical  to  pii)  and  piii)in  Proposition  1. 

From  a  conceptual  point  of  view  it  is  important  to  underline  the 
resemblance  between  the  properties  of  the  set  of  transformatorsT 
considered  in  Propositions  2  and  4  and  the  familiar  properties  of  a  set 
of  orthogonal  "projection-operators".  In  particular  i’l  Section  4.8, 
it  is  shown  that,  in  the  case  of  a  very  special  subsri  the  trans- 
formators  T  can  indeed  be  identified  as  orthogonal  projectors.  In 
general  the  following  proposition  holds. 

Proposition  5.  Suppose  that  a  set  of  transformatorsT  has  the  proper¬ 
ties  pi-ii-iii)  considered  in  Proposition  1.  Then  the  transformators 
are  additive  and  iderapotent. 

Proof. 

Let  us  start  to  prove  that  the  transformators  T*  are  additive. 

a 

To  this  purpose  consider  two  operators  T  and  T'  and  let  Y  be  the 
operator  defined  by  the  follov/ing 
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ZXfT+r]-  ZTfTj-  rXfT’] 

OE^  OE^ 

where  fl  =  {A,C,  M,X}.  From  piii)  we  have  that  the  operator  Y  is 
null.  Compute  nowT  [yJ.  In  view  of  pi-ii)  we  obtain 

T  [YJ^XIT  +  T-]  -T^(T]  -X[T']=*. 


It  follows  that 


Let  us  now  show  that 


Then  by  p  iii)  we  have 


a 


.  Suppose  that  T  is  an  operator  in  $. 


(T]  +“:•  [T]  +T^  (Tj  4"^  [T]  =  T. 

Apply  nowTT  to  both  members  of  the  above  equation.  The  desired 


result  is  an  immediate  consequence  of  pii) . 


As  we  observed  in  a  footnote  at  the  beginning  of  this  sec  ion,  a 
canonical  causality  decomposition  can  also  be  envisioned  in  terms  of 
systems  which  are  a  e  {A,  C,  M,X},  Using  tecii  jques  similar  to 
those  illustrated,  all  of  the  previous  results  could  be  rephrased  and 
proved  in  order  to  accommodate  this  alternative  formulation.  In 
particular,  for  instance,  in  correspondence  to  Theorem  1  we  would 
obtain  the  following. 

Proposition  6.  Every  system  can  be  uniquely  decomposed  into  the  sum 
of  strictly  causal,  strictly  ant’causal,  memoryless  and  crosscausal 
components. 
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Exaiiq)le  2.  Consider  the  system  discussed  in  Example  1.  According 
to  Proposition  6  this  i^stem  can  be  uniquely  represented  by  the 
e:q;>ression 

In  particular  T^,  T^,  Tj^  and  are  defined  as  follows:  if 
x,y  €  S[G,  */]  andy=  T^x,  ae  {A,C,  M,X},  then 

[yj  =  (X3)  ^ 

■yj  =  0 

Tg:  iy2=5(Xi)2  T^; 

73  =  ^ 

2. 7  Causality  and  Weakly  Additive  Operators  in  GRS 

In  this  section  the  results  of  Sections  4,  5  and  6  are  specialized 
for  the  case  in  which  the  systems  under  consideration  are  weakly 
additive. 

Definition  1.  An  operator  T  on  Sf  G,  v]  is  weakly  additive  if  it  has  the 
following  property 

T[xJ  =  T[P^x]  +  T[P^x]  =  T[P^x]  +  T[P^xj 


for  all  X  €  S[  G,  v]  and  every  t  e  v. 
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In  control  and  comnmnication  theory  a  weakly  additive  operator 
is  a  convenient  system  model  in  those  situaticms  where  the  sources  of 
nonlinear  behavior  have  i  memoryless  character.  Operators  with  the 
weak  additivity  property  have  already  been  considered  in  the  technical 
literature  [23],  [  3S],  [40],  [69  ].  Their  importance  will  be  further 
emphasized  in  Chapter  5  where  some  important  implications  of  this 
property  will  be  studied.  In  the  sequel  it  is  shown  that  most  of  the 
causality  properties  which  are  usually  stated  ^or  the  class  of  linear 
systems,  hold  ’Verbatim"  for  the  more  general  case  of  weakly  additive 
systems. 

Proposition  1.  For  a  weakly  additive  system  T  the  following  statements 
are  equivalent: 

a)  T  is  causal 

b)  P^x  =  ((>  implies  that  P^Tx  = 

c)  TP^  =  PjTP^ 

d)  P^T  =  P^TP^ 

e)  T=  5]  dP(s)TP^ 

sei^ 

Proof,  a)  — >  b) .  Suppose  that  T  is  causal.  Then  for  every  t  e  v  and 
all  X,  y  e  S[G,  v]  such  that  P^x  =  pV,  we  have  P^Tx  =  P^Ty.  In  par¬ 
ticular  if  P^x  =  (p  then  P^Tx  =  P^T(/>  =  <t>. 


b  c) .  Suppose  that  TP^  *  ^t'^t*  there  exists  an 
X  in  S[G,  u]  such  that  TP^jx  *  P^TP^jx.  This  implies  that  f^TP^x  = 

If  we  use  the  notation  P^x  =  y,  then  we  have  pVy  *  0  and  P^y  =  ift. 
This  is  a  contradiction  to  b) . 

c)  — ^  d) .  If  P^T  *  P^TP*  then  by  the  weak  additivity  of  T  we 
have  P^TPj  *  It  foUows  TP^  =  P^TP^  +  P^TP^  ^  P^TP^.  This  is 
a  contradiction  to  c) . 

The  proof  of  d)  — >  e)  and  e)  — >  a)  is  identical  to  that  given  in 
Proposition  4. 1. 

The  attention  of  the  reader  is  called  to  the  formal  equivalence 
between  the  above  result  and  Proposition  2. 3  in  [48  ] .  From  the 
principle  of  causal  duality  and  Proposition  1  we  obtain  the  next 
proposition. 

Proposition  2.  If  T  is  weakly  additive  the  following  statements  are 
equivalent: 

a)  T  is  memory  less 

b)  P^x  =  0  implies  P^Tx  =  ^  and  P^x  =  implies  P^Tx  =  </> 

c)  TP^  =  P*TP^  and  TP^  -  P^  TP^ 

d)  P^T  =  P*TP^  and  P^T  =  P*TP^ 

e)  T=  2  dP(s)TdP(s). 

sev 
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The  following  two  propositions  indicate  that  in  the  case  of 
weakly  additive  ^sterns  the  concepts  of  stroi^  and  strict  causality 
are  equivalent  and  the  concept  of  crosscausality  vanishes. 

Proposition  3.  For  a  weakly  additive  system  the  concepts  of  strong 
and  strirt  causality  are  equivalent. 

Proof.  Since  every  strictly  causal  system  is  also  strongly  causal 
it  is  sufficient  to  show  that  if  a  system  is  weakly  additive  and  strongly 
causal  then  it  is  also  strictly  causal.  Suppose  then  that  T  is  weakly 
additive  and  stroi^ly  causal.  Applying  Proposition  4. 3  we  obtaii 

T=  ^  dP(s)TP® 
sev 

and  from  the  weak  additivity  of  T 

T=  ^  dP(s)TP®+  Yj  dP(s)TdP(s). 
set'  set' 

Applying  again  Proposition  4.3  we  must  have  Y  dP{s)TdP(s)  =  </>. 

set' 

Hence  T  is  strictly  causal.  ^ 

Proposition  4.  If  T  is  weakly  additive  and  crosscausal  then  T  is  the 
null  operator. 

Proof.  If  T  is  a  weakly  additive  operator  on  Sf  G,  t'j  then  for  every 
X  e  sf  G,  t'j  we  can  write 

Tx=  V  dP(s)TdP(s)x  +  Y  dP(s)TP®x+  dP(s)TP  x. 
se  t'  se  t*  s€  t* 
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that  T  is  also  crosscausal.  Then  we  can  apply  Proposition 
4. 5  and  obtain  that  all  the  terms  on  the  right  hand  side  of  the  above 
equation  are  null.  This  implies  that  T  is  the  null  operator. 

Observe  that  in  view  of  Propositions  3  and  4  the  containment 
relations  indicated  in  Figure  2. 2  can  be  simplified  as  in  Figure  2. 3. 

In  regard  to  a  canonical  decomposition  theorem  for  weakly 
additive  operators,  we  have  the  following  result. 

Theorem  1.  Every  weakly  additive  system  can  be  uniquely  decomposed 
into  the  sum  of  strictly  causal,  strictly  anticausal  and  memoryless 
weakly  additive  systems. 

Proof.  Suppose  that  T  is  an  operator  on  S[  G,  v] .  By  Theorem  6. 1 
T  has  a  unique  canonical  decomposition  T  =  T^  +  T^  +  Tj^  +  T^. 

If  T  is  weakly  additive  then  for  each  s  e  the  operator  dP(s)  T  is 
weakly  additive.  This  implies  that  dP(s)T^  and  dP(s)T^  are  also 
weakly  additive.  Suppose  for  instance,  that  dP(s)  is  not.  Then 
we  would  have  a  point  t  €  y,  t  <  s,  and  an  element  x  e  S[  G,  i>]  such 
that  dP(s)  T^P®  *  dP(s)  T^P^x  +  dP(s)  T^(P®-  x.  This,  however, 
is  not  possible  because  by  the  weak  additivity  of  dP(s)  T  we  have 

dP(s)T^P®x  =  dP(s)TP®x  =  dP(s)TP^x  +  dP(s)T(P®-  pV 

=  dP(s)T^P^x  +  dP(s)T^(P®-  P^x. 


UNIVERSE  OF  WEAKLY  ADDITIVE 
SYSTEMS 


Figure  2. 3  ;  Relations  of  containment  am  "  /a^ious  causality 
classes  of  weakly  additive  sy  jtems. 
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From  the  weak  additivity  of  dP(s)  and  dP(s)T^  we  obtain  the 
weak  additivity  of  and  T^.  Moreover  since  every  memoryless 
operator  is  weakly  additive  so  is  Tj^.  It  follows  that  must  also 
be  weakly  additive.  We  can  now  apply  Propositions  3  and  4  and 
obtain  =  </>,  and  =  T^.  We  can  then  conclude  that  if 

T  is  weakly  additive  then  T  has  the  unique  decomposition  T  =  T^-  + 

A 
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2.8  Summary 

This  chapter  is  characterized  by  the  development  of  a  mathe¬ 
matical  setting  in  which  some  basic  causality  questions  may  be  studied. 
It  contains  two  novel  ideas:  the  use  of  the  structure  of  group  resolu¬ 
tion  spaces  and  the  introduction  of  the  class  of  crosscausal  operators. 
These  two  ideas  are  exploited  to  discuss  with  a  certain  mathematical 
rigor  various  important  properties  related  to  system  causality.  These 
properties  are  emphasized  by  a  number  of  propositions  and  theorems 
in  Sections  4,  5, 6  and  7. 

The  most  important  theoretical  results  consist  of  Theorems 
6. 1  and  7. 1.  Theorem  6. 1  gives  a  general  canonical  clecompofition 
theorem  for  nonlinear  operators  on  nonlinear  spaces.  It  can  be 
stated  as  follows:  every  system  in  a  groui,  resolution  space  can  be 
decomposed  into  the  sum  of  strongly  causal,  strorigly  anticausal, 
memoryless  and  strongly  crosscausal  systems.  When  the  system 


oiidar  consideration  has  a  *^7eak  additivity*’  property  then  the  statement 
o£  Thecrem  6. 1  can  be  improved  to  the  form  of  Theorem  7. 1.  This 
latter  theorem  also  provides  a  canonical  decomposition  of  the  type 
coiqectured  1^  Saeks  [  48  ] .  To  paraphrase  this  result:  every  weakly 
additive  ^stem  in  a  group  resolution  space  is  given  by  the  sum  of 
strictly  causal,  strictly  anticausal  and  memoryless  weakly  additive 
^sterns. 


3.  CONNECTIONS  BETWEEN  THE  CONCEPTS 
OF  CAUSALITY  AND  STATE 

3. 1  Introduction 

In  the  previous  chapter  the  structure  of  a  system  with  respect  to 
time  related  behavior  was  investigated.  This  included  the  study  and 
formulation  of  various  causality  concepts. 

It  should  be  observed  that  the  concept  of  state  is  also  related  to  the 
temporal  behavior  of  a  system.  Heuristically  speaking,  causality  con¬ 
cepts  reflect  the  modalities  by  which  past, present  and  future  of  the  input 
affect  the  present  of  the  output,  while  the  concept  of  state  indicates  how 
past  and  present  of  the  input  affect  the  future  of  the  output. 

From  the  above  observation  the  question  arises  as  to  whether  the 
knowledge  of  the  causality  structure  of  a  system  supplies  some  infor¬ 
mation  about  the  system  state  structure  and,  conversely,  whether  the 
state  structure  might  have  ramifications  concernirig  the  causality 
structure..  To  investigate  this  question  it  is  convenient  to  model  a  sys¬ 
tem  as  an  operator  on  a  group  resolution  space  (GRS) .  A  first  order 
of  business  is  to  properly  define  in  this  context  the  concept  of  state. 

The  format  of  the  present  chapter  is  a  natural  realization  of  i  his 
line  of  reasoning.  In  Section  2  we  establish  the  notion  of  state  in  GRS. 
Section  3  deals  with  some  characterizations  of  the  structure  of  a  system 
with  respect  to  state.  In  Section  4  interconnections  between  state  and 
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causality  concepts  are  developed.  Section  5  closes  the  chapter  with 

I 

some  concluding  re niarks. 

3.2  On  the  Notion  of  State  in  GRS 

In  developing  the  coj^pt  of  state  we  are  faced  with  satisfying 
two  partially  competing  requirements:  the  notion  of  state  has  to  have 

I  ' 

sufficient  generality  to  encompass  systems  in  the  various  engineering 

I 

fields  of  interest;  the  notion  has  to  be  flexible  enough  as  to  lead  the 
investigation  to  meaningful  results. 

A  concept  of  state  based  on  equivalence  classes  would  be  suffi¬ 
ciently  general.  Such  an  approach  was  used  by  Mesarovich  [  33  ], 

t 

Windernecht  [  60]  and  Zadeh  [64  ]  among  others,  and  could  easily  be 

I 

formalized  in  our  mathemat'cal  framework.  Such  a  development  does 
not  appear,  however,  to  be  sufficiently  flexible.  The  notion  of  state 
via  the  definition  of  a  state  decomposition  as  recently  proposed  by 
Sacks  in  [48],  is  another  potential  alternative.  Translated  in  the 
framework  of  group  resolution  spaces  (GUS)  ti  c  following  definition 
would  be  obtained:  a  state  decomposition  of  a  system  T  on  S[G,  is 
a  triple  (i//(t),  S,  V(t) )  where  S  is  a  set  (state  set)  and  ;/^t) ,  C(f)  ai’e 
families  of  mappings  such  that 

W)  ^t)  =  VWpS  C(t)  i;(t;  (3,1) 

and 

I 

C(t)i/^t)  =  (3.2) 


for  every  t  e  v. 


This  latter  definition  is  quite  satisfactory  in  a  linear  system 
context.  It  is  not  fully  satisfactory,  however,  in  the  more  general 
framework  under  consideration.  The  deficiency  of  this  definition  resides 
in  part  in  the  fact  that  this  concept  does  not  satisfy  the  "consistency 
conditions"  required  by  Zadeh  [  65] .  In  particular  it  can  happen  that 
the  knowledge  of  the  state  of  a  system  T  at  a  certain  time,  t,  is  not 
sufficient  to  describe  the  input-output  behavior  of  T  after  t.  This  can 
perhaps  be  best  illustrated  by  introducing  a  simple  example. 

Example  1.  Consider  the  system  T  which  was  discussed  in  Example 
2. 3. 1.  Recall  that  if  x  and  y  belong  to  S[  G,  v]  then  x  and  y  are  real 
functions  defined  on  the  interval  [0,  oo) .  Moreover  if  y  =  Tx,  then  y 
is  given  by  the  following  expression: 


y(t)  =  x{t+T^)  x(t+T2) . 

If  we  now  suppose  that  ~  -g-  Tg  =  ,  then  the  triple 

(U^t) ,  S,  ^t) ) ,  with  S  consisting  of  a  null  element,  0,  and  ^t)  mapping 
S  into  the  null  element  of  S[G,  u],  satisfies  Equations  (3. 1)  and 
(3.2) ,  Therefore  according  to  the  definition  of  state  introduced  by 
Sacks,  this  triple  is  an  admissable  state  decomposition  of  T.  In  this 
case,  however,  the  state  would  fail  to  give  an  adequate  description  of 
the  past  configuration  of  T  so  that  the  future  behavior  of  T  can  be 
satisfactorily  characterized.  For  instance,  if  t  =  2  is  the  present 


time,  then  from  the  state  of  T  at  t  and  the  future  of  x,  we  cannot  in 
general  evaluate  the  future  of  y  =  Tx.  Indeed,  the  future  of  y  depends  on 
the  values  of  x  in  the  intei*val  (1.  5,  2]  and  no  record  of  these  values 
can  be  found  in  the  state  of  T. 

In  the  present  study  attention  is  focused  on  a  generalization  of 
the  state  decomposition  format.  In  statii^  this  generalization  S j,  Sg 
are  sets  and  S  =  x  S2  plays  the  role  of  the  state  set.  Similarly 

parameterized  families  of  mappings  while 
0(t)  =  (^j(t))/^(t) )  and  ^t)  =  (^j(t),^(t))  play  the  role  of  input-to- state 
and  state -to- output  mappings.  Our  format  definition  is  the  following. 

Definition  1.  A  state  decomposition  of  an  operator  T  on  S[  is  a 
triple  {\Kt) ,  S,  §(t) )  such  that: 

i)  S  -  Sj  X  S2  where  S j,  $2  are  sets 

ii)  i//(t)  =  (i//j(t) ,  ) ,  where  domain  [  ]  =  P^'Sf  G,  ^']  and 

range  i/4(t)_c  s.,  i=l,2,t€  v 

iii)  ^t)  =  (?j(t),^(t)),  where  domain  q{t;  -  S.,  range 

^j(t)  c  P^S[  G,  1^]  and  the  range  of  ^2(1)  is  contained  in  the 
space  of  operators  on  P^^Sj  G,  u\ 

For  every  x,  y  e  S[  G,  v]  the  following  relations  are 


4(t)i//j(t)P^x=  P^TP^x 


So(t) 


[i^2lt)|P^xl]P^y 


=  6T 


ni  '  t 

P  X 


satisfied 
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where  the  symbol  6T  fyj  stands  for  T[x+y]  -  Tx-Ty. 

By  the  substitution  of  the  term  ''state**  with  "costate"  and  by 
a  subsequent  substitution  of  symbols  as  indicated  in  the  principle  of 
causal  duality,  Definition  1  provides  a  concept  which  is  dual  to  that  of  a 
state  decomposition.  As  this  concept  will  also  be  useful,  we  introduce 
the  following  additional  definition. 


Definition  2.  A  costate  decomposition  of  an  operator  T  on  S[G,  v]  is 
a  triple  (i/<t) ,  S,  4{t) )  such  that: 

i)  S  =  Sj  X  S2,  where  Sp  Sg  are  sets 

ii)  =  (j//j(t) ,  )  >  where  domain  [  (/^(t)  ]  =  P^Sf  G,  u] 

and  range  i//.(t)  c  i=l,2,  t  €  v 

iii)  ?(t)  =  (q(t) ,  ^(t) ) ,  where  domain  ^^(t)  =  S.,  range 

c  P*S[  G,  v]  and  the  range  of  ^(t)  is  contained  in 
the  space  of  operators  on  P^S[  G,  v] 

iv)  For  e’*ery  x,  y  e  S[  G,  v]  the  following  relations  are 
satisfied 


q(t)i//j(t)p^x=  p^TP^x 


^(f)  C 


pV 


=  STp^JpVl. 


In  Definition  1,  a  state  decomposition  can  be  viewed  as  given  by 


two  components: 


i)  the  first  component  (i/'j(t),  Sj,Cj(t) )  reflects  the  influence 
of  the  past  of  the  input  over  the  future  of  the  output  with 


the  constraint  that  the  future  of  the  input  is  null; 
ii)  the  second  component  (i/^(t) ,  Sg,  )  indicates  how  the 
past  of  the  input  influences  the  effect  of  the  future  of  the 
input  on  the  future  of  the  output. 

The  proposed  state  decomposition  formulation  is  a  natural  exten¬ 
sion  of  the  formulation  of  Saeks.  The  main  difference  between  the  two 
consists  of  the  appearance  of  ,  S2,  ^(t) )  the  second  component 
of  the  state.  This  inclusion  allows  the  present  definition  of  state  to 
satisfy  the  forementioned  consistency  conditions  of  Zadeh  [  65  j .  The 
concept  of  state  proposed  by  Saeks  satisfies  these  conditions  only  in  the 
particular  case  in  which  the  system  is  weakly  additive  (Proposition  2. 4) . 
Thus,  by  the  introduction  of  the  component  ^ 

existing  between  the  definitions  given  by  Saeks  and  Zadeh  appears  to  be 
bridged. 


3. 3  State  Related  Concepts  in  GRS 

The  F^^ructure  of  systems  with  respect  to  the  notion  of  state  can  be 
diverse.  To  describe  the  variety  of  situations  which  can  occur,  it  is 
convenient  to  introduce  the  concepts  of  controllability,  observability 
and  minimality.  For  details  on  the  genesis  of  tl  ese  concepts  the  inter¬ 
ested  reader  is  referred  to  f  18  j . 


vu 


Definition  1.  The  state  decompocition  (^t) ,  S,  ^t) )  is  completely 
controllable  with  respect  to  the  first  (second)  component  if 
is  onto. 

Definition  2.  The  state  decomposition  ,  S,  5(t) )  is  completely 
observable  with  respect  to  the  first  (second)  component  if  ?j(t) 

(^(t))  is  1-1. 

Definition  3.  The  state  decomposition  is  minimal  with  respect  to  the 
first  (second)  component  if  it  is  completely  controllable  and  completely 
observable  with  respect  to  the  first  (second)  component. 

Definition  4.  A  state  decomposition  is  strictly  minimal  (strictly  com¬ 
pletely  controllable,  strictly  completely  observable)  if  it  is  minimal 
(completely  controllable,  completely  observable)  with  respect  to  both 
first  and  second  components. 

Definition  5.  Two  state  decompositions  {xj/X) ,  S,  ^t) )  and  ,  S',  C(t) ) 
are  strictly  equivalent  if  there  exists  a  unique  family  of  invertible 
mappings  tK(t)  such  that  the  following  conditions  are  satisfied 

m  =ac(t)v^(t)  and®)  =  rwK’V). 

In  what  follows  we  give  some  results  related  to  the  above  state 
concepts.  These  results  allow  a  better  appreciation  of  our  definitions 
and  consequently  a  better  understanding  of  the  results  of  the  next  section. 


ut 


They  are,  however,  not  essential  to  the  main  development  and  can  be 
omitted  at  first  reading. 

As  a  start,  the  following  proposition  gives  a  connection  between 
the  mathematical  concept  of  minimal  state  decomposition  and  the 
intuitive  notion  of  a  state  space  which  contains  only  "essential”  ele¬ 
ments. 

Proposition  1.  Suppose  that  the  completely  observable  (xpit) ,  S,  ^(t) ) 
and  the  strictly  minimal  gt))  are  state  decompositions  of  T. 

Then  there  exists  a  unique  family  of  mappings  CK(t)  taking  S  onto  S 
and  such  that 

^t)  =  mt)m  and  at)  =^(t)tK(t).  (3.3) 

Proof.  First  we  show  that  the  family  IIK(t)  exists  and  satisfies 
Equation  (3. 3) .  For  this  purpose  suppose  that,  at  index  t ,  v  is  the 
state  of  T  in  S.  Let  U  be  the  set  in  S[  G,  i^]  with  the  following  property: 

V  =  i/^t)  u  for  any  u  e  U. 

For  any  pair  u U2  in  U  we  have 

at)  \Kt)  u  j  =  at)  iMt)  Ug 

and  this  implies 


C.(t) i/,'.(t) uj  =  s>i(t)i^.(t)u2,  i=l,2. 


From  this  equation  and  the  definition  of  state  decomposition  it  follows 
P.TP^u,  =  P.TP^Un  and  P.6T  .  [  ]  =  P.6T  .  [  ], 

*  ^  ^  ^  ^  PUg 

and  from  here 

at)#)uj  = 

Moreover,  from  the  minimality  of  {^t) ,  S,^(t)) ,  ?(t)  must  be  1-1  and 
therefore  we  must  also  have 

j^t)Uj  =  l^OUg. 

Note,  at  this  point,  that  according  to  the  above  construction  at  each 
t  e  V  every  element  v  in  S  defines  a  unique  set  U  in  S[  G,  v] ;  such  a  set 
U,  in  turn,  defines  a  unique  element  v  in  S.  Thus  we  have  built  DC(t) 
a  family  of  mappings  S  ->  S.  Cleiirly  for  each  u  e  S[  G,  v]  we  have 

V  =  xj^t)  u  =  DC'*'  )/>(t)  u  =  CK(t)  V 

and  therefore  ^t)  =  [K(t)  xplX) .  We  also  :  .ve  ^t)  =  [K(t)^(t) .  This 
follows  from 

c(t)  mt)m  ut)»Mt) 

and  the  fact  that  \p{t)  is  onto. 

It  remains  to  be  proved  that  each  mapping  DC{t)  is  onto  and  that 
the  family  £K(t) ,  t  e  is  unique.  If  [K(t)  is  not  onto  then  there  exists 


a  state  v  e  S  such  that 


lK(t)V}^  V  for  every  VC  S.  (3.4) 

From  the  strict  minimality  of  (^t) ,  S,  C(t) ) ,  ^t)  is  onto.  Hence  there 
exists  an  input  u  c  S[  G,  v]  such  that  v  =  _^t)  u^.  Let  v  =  \p{t)  u^,  and 
let  U  be  a  subset  of  S[G,  v]  such  that 

V  =  i//(t)u^  =  i//(t)u,  for  any  u  e  U. 

Then  the  following  relation  holds 

y  =  j^t)  u  for  any  u  e  U 

and  from  here,  y  =  [K(t)  v.  This  is  a  contradiction  to  Equation  (3. 4) . 
Hence  LK(t)  must  be  onto.  Finally,  suppose  that  the  family  [K(t)  is 
not  unique.  Then  for  some  t  e  u,  there  would  exist  at  least  two  mappings 
[Kj(t)  and  OCgCt)  such  that  tKj(t)  7^  EKgCt)  and  Equation  (3. 3)  holds. 

This  implies  that  there  would  exist  an  element  v  e  S  such  that 

CK^(t)v;^  IKgWv  (3.5) 

f 

and 

*,(t)v=  C(t)  lK^(t)v  =  i(t)  [K2(tW. 

It  would  follow 

?(t)  lKj(t)v-£(t)  [K2(t)v=0. 

But  by  hypothesis  y(t)  is  1-1.  Hence  it  must  be  that 

CKj(t)v=  (K2(t)v. 

d 


This  is  a  contradiction  to  Equation  (3.5). 


The  next  proposition  shows  that  all  strictly  minimal  state  decompo¬ 
sitions  of  an  operator  T  are  strictly  equivalent.  This  is  a  generalization 
of  a  similar  well  known  result  in  the  context  of  linear  (fynamical  systems 
[  42] ,  [  65] .  A  result  of  this  type  was  also  given  by  Saeks  for  linear 
systems  in  Hilbert  space  [  49  ] . 

Proposition  2.  All  strictly  minimal  state  decompositions  are  strictly 
equivalent. 

Proof.  Suppose  that  (i//(t) ,  S,  C(t) )  and  (jgt) ,  S,  C(t) )  are  strictly  minimal 
state  decompositions  for  the  operator  T.  We  have  to  show  that  there 
exists  a  family  of  invertible  mappings  CK(t)  such  that  the  equations  m 
Definition  5  are  satisfied. 

From  Proposition  1,  we  know  that  there  exists  a  family  of  onto 
mappings  DC(t) :  S  ->  S  such  that 

^t)  =  CK(t);Kt)  andC(t)  =  C(t)  CK(t). 

Therefore  all  we  have  to  show  is  that  CK(t)  is  1-1.  If  CK{t)  is  not  1-1 
there  would  exist  two  elements  v,  v^  e  S  such  that  v  v^  and  QC(t)  v  = 

CK(t)  Vy.  It  would  follow  that 

«t)  V  =  ^(t)  CK(t)  V  =  £(t)  QC(t)  =  m  Vo, 


and  this  equation  is  a  contradiction  to  the  fact  that  by  the  strict  mini¬ 
mality  of  the  state  decomposition  ^(t)  is  1-1. 


An  additional  property  of  a  strictly  minimal  state  decomposition 
is  that  it  allows  to  define  the  notion  of  a  "transition  operator"  (Saeks 
[49  j). 

Proposition  3.  Suppose  that  ,  S,  ^t) )  is  a  strictly  minimal  state 
decomposition.  For  q  <  t,  t,  q  e  i',  assume  that  no  input  to  the  system 
occurs  between  q  and  t.  Then  there  exists  a  well  defined  mapping 
$(t,  q)  such  that 

v(t)  =  ^<t,q)v(q) 

where  v  is  the  state  of  the  system. 

Proof.  To  every  element  t  e  i/  and  each  element  v  e  S,  associate  U(t) , 

a  subset  of  P^S[G,  v] ,  such  that  U(t)  is  maximal  with  respect  to  the 

following  property:  if  u  e  U(t) ,  then  v  =  iKt)  u.  This  defines  the  family 

of  mappings  M(t) :  S-^IP{S[G,  t']}  where  IPjSf  G,  u]  }  indicates  the 

t 

power  set  of  S[  Gjt']  .  Conversely,  to  every  subset  U(t)  c  P  S[  G,u] 
with  the  property  that  there  exists  a  veS  such  that 

V  =  any  u  e  U(t) , 

associate  the  element  v.  This  defines  a  family  of  mappings 

Let  t,  q  e  v,  t  ^  q  and  suppose  that  is  an  input  to  T  such  that 
[P^-P^Ju  -  </;,  Consider  the  states  v(t)  and  v(q)  giveu  by  the  following 


equations 


(3.6) 


v(t)  =  iMt)P*u,  v(q)  = 

In  what  follows  it  is  shown  that 

v(t)  =  |[M(t)r^M(q)v(q),  (3.7) 

thus  ^(t.q)  =  lM(t)  ]l"^M(q)  is  the  mapping  whose  existence  was  to  be 
proved. 

The  proof  of  Equation  (3.7)  is  equivalent  to  the  proof  of  the  fol¬ 
lowing  equation 


M(q)v(q)  c  M(t)v(t). 


Suppose  that  u  e  U(q)  =  M(q)  v(q) .  From  the  definition  of  state  decompo¬ 
sition  and  Equation  (3.6)  we  have  the  following 


C(q)v(q)  = 


Ci(q)vi(q) 

^(q)v2(q) 


/ 


P  TP% 

q 


for  all  u  €  U(q) .  It  follov’s 

\(t)Vj(t)^ 


«t)v(t)  = 


^(t)  V2(t) 


\ 


^P^TP^u 


P.TP% 


=  allue  U(q). 


\ 


[  J 

\  Pu 


\  /p  o  nPTjq 


P.P^TP^U 
t  q 


'.VV  >1 


I 


P  TP^ 


P  6T  ,  f  ] 
\  ’  P\ 


7C 


From  the  above  eqaation  the  fact  that  ^(t)  is  1-1  we  hrve 

v(t)  =  ^t)  P%,  all  u  €  U(q) 

and  therefore  :(q)  =  U(t) .  The  proof  is  tlus  complete. 

The  operator  ^t,q)  is  called  the  Transition  operator  of  the  state 
decompositkm.  Ao  interesting  corollary  to  the  .ibove  result  i5  the 
foUcvtng. 

Corollary  1.  Let  4(t,q)  be  che  transition  operator  of  a  strictly  tnmimal 
state  decomposituHi  (^t* .  ^ti ) .  Then 

«t.tj  -  I 

^t.r)  ^  4(t.q^l4(q,r),  t  >q  >r. 

In  Seciioa  2.  ?  we  observed  that,  when  a  svstetr  is  weakly  additive, 
the  causality  definitions  presented  in  this  deve!onm»nt  coincide  with 
those  proposed  by  Saek.s.  The  n^jural  question  th^n  is  whethex  a  simi¬ 
lar  situaii'.m  occurs  for  the  definition  of  stale  dec'^imposition.  In  mo^c 
precise  terms:  is  it  true  that  in  the  case  of  weakly  additive  systems 
Saeks*  concept  of  a  state  decomposition  coincides  with  the  c'-rKrept 
•ormalized  in  Definition  1- 1?  The  following  shows  that  the 

answer  to  this  -jiiestion  is  affirn:ct:v<. 

Before  statirc  this  result  it  is  convenient  t  pause  for  a  mon*cni 


<ind  clari/v  some  additronal  shorthand  notatiorih.  It  wiii  oe  s.  d  that  a 


71 


I  Slate  decom^sitioi:  (^t) ,  S,  ^t) )  has  its  second  component  given  by 

I  the  triple  if  $2  has  only  one  element  (again  indicated  by  4») 

t 

;  and  ^(t)  maps  this  element  into  the  null  operator  on  P^S[G,  i/] . 

Finally  a  state  decomposition  (t^i)  <j(t))  is  given  by  the  triple 

if  both  its  first  and  second  components  are  given  by  the  triple 

Proposition  4.  tf  T  is  weakly  additive  then  it  has  a  state  decomposition 
whose  second  component  is  given  by  the  triple  {6,  <(>) . 

Proof.  Choose  a  triple  {iH*) ,  S,  gt) )  where  ^t)  =  (^^(1) , ,  S  =  (Sj,  <ft) 
5(t)  =  (C|(t>  ,♦)  and  S^,  Cj(t) )  is  any  admissable  first  component  for 

a  stale  decomposition  of  T.  To  prove  that  (^t) ,  S,  gt) )  is  admiesable 
it  is  sufficient  to  show  that  (i/^(c) ,  Sg,  i^(t) )  =  (<^,  4)  satisfies  the 

requirements  of  Definition  1. 1.  That  this  is  indeed  the  case  follows 
from  the  relation 

t  i  VJ  •-  V*  V  *  Vi  ■  V!  P‘“J  =  * 

Pa  ' 

whjch  is  valid  for  all  P^x  c  P^Sf  G,  i'l  ax»d  P‘u  €  P*S(  G, »/] . 

3.4  Some  Connectious  Ec»tween  Causality  and  State  Pr<^rties  in  GRS 

Ho'iristically,  if  a  system  is  nMlcausal.  then  its  state  should 

be  racuous.  This  result  is  given  Tnaihema^icai  >  ^ger  ir  the  following 


proxjsilicn. 
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Proposition  1*  K  T  is  anticausal  then  it  has  a  state  decomposition  given 
by  the  triple  (<^,  <l>) .  Conversely,  if  the  triple  (<^,  <^,  <>)  is  an  admis- 

sable  state  decomposition  for  T,  then  T  must  be  anticausal. 

Proof.  Skippose  that  T  is  anticausal.  Then  for  every  element  u  c  S{  G,  j/j 
and  t  e  i;  we  have  P^Tu  =  P^TP^u  and  therefore  P^TP*'u  =  dn  Similarly, 
for  any  x  e  Pj.Sf  G,!*!  aiid  t  e  we  have 

R6T„t  fx]  =  P.T[P*u+P.x]  -  P.TP^u-F.TP.x  r-. 
tPu‘^  t‘  t^  t  tt 

and,  from  here,  j  -  ❖•  Choose  now  the  triole  ,  S,  s(t) ) 

such  that  S  =  («i,  <;&) ,  i/<t)  =  (c^,  5)  and  ^t)  =  (6, 6) .  In  view  of  the  above 
equations  it  is  trivial  to  verify  that  this  triple  satisfy  the  requirements 
of  Definition  1. 1  and  therefore  it  is  an  admissable  state  (tecouposition 
for  T.  Conversely,  suppose  that  the  triple  (6, 6, 6)  is  an  admissable 
state  decomposition  for  T.  Then  from  Definition  1. 1,  we  have 

PJP*  =  i  and  r,T{  P*u  +  P.xj  -  P.TP*u  -  P.TF.x  -  6. 

From  this  it  follows  that  P^T  --  ^nd  appi-  »  the  dual  of  Propo¬ 

sition  3. 1  :.v€  can  conclude  that  T  is  anticausal 

In  the  case  of  memoryles-s  system^  (uhit:h  are  ?nticausal)  a 
straightforward  application  of  the  above  proposition  and  of  the  principle 
<rf  causal  duality  generates  the  Iwilow.ng  corollarv 

•A  result  of  this  type-  ^as  i:r.st  t  stab.’ish  ■  Sat  k:-  :r.  a  I’near 
system  context  '  se#-  > 


Corollajy  1.  A  necessary  and  sufficient  condition  for  T  to  be  memory¬ 


less  is  that  the  triple  <^)  be  simultaneously  an  admissable  state 
and  costate  decomposition  for  T. 

Corollary  2.  K  the  system  T  is  anticausal  then  it  admits  a  strictly 
minimal  state  decompositiai. 

When  a  ^stem  is  crosscausal  a  result  similar  to  Proposition  1 
can  be  stated. 

Proposition  2.  If  T  is  crosscausal  then  there  exists  a  state  decompo¬ 
sition  with  first  component  given  by  the  triple  (<^,  (^) .  Conversely, 

if  T  has  a  state  decomposition  with  first  component  given  by  the  triple 
{4>t  4't  f  given  by  the  sum  of  a  crosscausal  plus  an  anticausal 

operator. 

Proof.  First  we  show  that  the  triple  (^j{t) ,  S^,  Cj(t) )  =  (<^,  <^)  is  an 

admissible  first  component  for  a  state  decomposition  of  T,  where  T 
is  crosscausal.  Beginnii^  with  Proposition  2. 2. 3,  we  have  ^(s)  TP^= 
for  each  s  >  t.  This  implies  that 

P  TP‘  =  dP(s)  TP*  =  6. 
s>t 

From  here  it  follows  easily  that  (*vj(t) ,  Sj,  <j(t) )  ^  (d,d,c>)  satisfies  the 
requirements  of  Definition  1. 1  and  therefore  is  an  admissible  first 
compmieitf  for  a  state  decomposition  of  T. 
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Suppose  now  that  the  first  component  of  a  state  decomposition  of 
T  is  given  \jy  the  triple  (^,  <^) .  This  implies  that  we  must  have 

=  </>  for  every  tev.  (3. 9) 

Note  that  from  Proposition  2.6.6  we  can  v/rite 

T  =  Ta  +  +  T^,  (3. 10) 

where  Ta>  uniquely  defined  anticausal,  crosscausal  and 

strictly  causal  operators.  From  the  dual  of  Proposition  2.4. 1  and 
Proposition  2. 4. 3  we  have 

P.T  . P*  =  P.P*T .  P^  =  <^  and  P*T^P*  =  P. P*T.^P*  = 
tA  tA  tX  tX 

From  Ihese  relations  and  Equations  (3.9)  and  (3. 10)  it  follows  that 

P^T^P^  =  0.  This  implies  dP{s)  T^P^  =  0  whenever  s  >t  and  from  the 

fact  that  T^  is  strictly  causal  it  follows  that  T^  is  a  null  operator. 

From  this  and  Equation  (3. 10)  we  can  conclude  that  T  is  given  the 

addition  of  a  crosscaucal  plus  an  anticausal  component.. 

Corollary  3.  If  T  is  crosscausal  then  ii  admi<  -  .i  state  decomposition 
which  is  minimal  with  reflect  to  its  first  component. 

Before  proceeding  further  it  i.s  convenient  to  ;ntroduce  the  fol¬ 
lowing  result  which  is  a  useful  tool  in  extendii^  Propositions  1  and  2. 

Propositio.T  5.  Let '-...'(t) ,  S',  (’(t)  >  and  (.y’Jt) .  S r'  ;tn  be  two  state 
decompositions  for  T'  and  T"  respectively..  Jiv..  i*'  ^dmissable  state 
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decomposition  for  T  =  T'  +  T"  is  given  the  triple  (^t) ,  S,  ?(t) ) , 
where 


>i(t)  =  (t),i//j’(t)),  i=l,2,  te  V 

(.)  !  Sj=Sj'xS^’,  1=1,2,  t£  r 

?l(t)  Sj  =  ?!  (t)  s!'  +  ?;' (t)  s" ,  i=  1, 2,  t  e  1/ 

s.  =  (s.',sp  €  Sj  X  S",  i;=l,2. 

Proof.  To  show  that  the  triple  (^j{t) ,  Sj,  C j(t) ) ,  defined  by  (*)  for 
i=l,  is  an  admissible  first  component  for  a  state  decomposition  of 
T  =  T*  +  T*',  it  is  sufficient  to  shjw  that  the  following  holds 


where 


CjMif-jd)  =  PjTP*. 

Since  (^^(t),S',?’(t))  and  (^"(t),S*',C*'(t))  are  state  decompositions 
of  T*  and  T”  respectively,  we  must  have 

=  PjT’P^  and  rjWV'j’Ct)  =  PjT"P^ 


It  follows  then  that 


Ci(t)^^l(t)  =  q(t)i;/j(t)  +  ri’(t)^j'(t)  =  P^T'P*  P^T"P* 

=  P^(T*  +  T")  P*  =  P^TP^ 

This  implies  that  ,  S|,  C  j(t) )  is  an  admissable  first  component 
.or  3  state  decomposition  of  T. 

Using  an  identical  argument  it  can  be  shown  that  (v^(t/ .  S2,  <2*^)  ^ 
defined  by  (•)  is  an  admi -sable  second  component  for  a  state  decompo- 
sition  of  T. 
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Using  Proposition  3,  the  results  in  Propositions  1  and  2  can  be 
applied  in  more  general  situations.  This  is  illustrated  by  the  fol¬ 
lowing  Propositions  4,  5  and  6. 

Proposition  4.  For  every  operator  T  there  exists  a  state  decomposition 
with  the  property  that  the  first  component  depends  only  on  the  strictly 
causal  part  of  T. 


Proof.  Applying  Proposition  2. 6. 6,  T  can  be  represented  as  follows 

Oppose  that  (^(t) ,  S^,  ^^(t) ),  a  e  {A,  C,  M,  X},  are  state  decompositions 
T^,  T^,  and  Tj^  respectively.  By  Propositions  1  and  2, 

ff  e  { A,  M,  X},  can  be  chosen  in  such  a  way  that  the 
first  component  is  given  by  the  triple  (<f>,  0, 0) .  A  state  decomposition 
(’Kf) ,  S,  ^t) )  for  T  can  now  be  obtained  by  the  procedure  indicated  in 
Proposition  3.  The  first  component  of  this  state  decomposition  depends 
clearly  only  on  T^. 

Proposition  5.  If  the  strongly  causal  component  of  T  is  weakly  additive, 
then  there  exists  a  state  decomposition  with  the  property  that  the  first 
component  depends  only  on  the  strictly  causal  part  of  T  and  the  second 
component  depends  only  on  the  strongly  crosscausal  part  of  T. 


Proof.  Consider  again  the  representation  T  -  T^. 

Py  the  application  of  Proposition  1  and  2.4  u  .  ‘ossible  to  find  state 
decompositions  for  and  with  tne  property  mat  the  second 
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component  is  given  by  the  triple  (f>) .  The  rest  of  the  proof  can 
be  obtained  through  an  argument  identical  to  that  used  in  the  proof 
of  Proposition  4.  ^^3 

Proposition  6.  A  necessary  and  sufficient  condition  for  T  to  admit 
a  state  decomposition  with  a  first  component  given  by  the  triple 
(0, 0, 0)  is  that  the  strictly  causal  part  of  T  is  null. 

The  proof  of  Proposition  6  uses  techniques  similar  to  those  seen 
in  Propositions  4  and  5  and  will  be  omitted  for  brevity. 

To  help  motivate  the  next  result,  observe  that  a  system  can 
clearly  have  more  than  one  state  decomposition.  Conversely,  Propo¬ 
sitions  1  and  2  indicate  that  a  state  decomposition  can  correspond 
simultaneously  to  many  systems.  The  natural  question  that  arises  is 
concerned  with  what  must  be  in  common  to  two  systems  in  order  that 
they  can  both  have  the  same  state  decomposition.  The  answer  to  this 
question  is  given  by  the  following  theorem. 

Theorem  1.  A  state  decomposition  of  T  defines  uniquely  the  strongly 
causal  and  strongly  crosscausal  components  of  T. 

Proof.  We  have  to  show  that  if  two  systems  T  and  T'  admit  an  identical 

state  decomposition  {0(t) ,  S,  ^(t) ) ,  then  T  =  T'  and  T  =  T' ,  where 

_  C  _  _ 

T^,  Tj^  and  T^,  T^  are  strongly  causal  and  stroi^ly  crosscausal  com¬ 
ponents  respectively  of  T  and  T'.  Consider  the  operator  T  -  T'.  By 
the  application  of  Proposition  3,  a  slate  decompr  sition  of  T  -  T'  is 
given  by  ,S,  (it) ),  where,  u.sing  the  notation  of  Proposition  3, 
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5i(t)  =  c  SjX  s. 

i=l,2  and  ^(t)  is  defined  as  follows:  if  (v^v.)  €  then^.(t)T.  = 

?iVi  -  ?jv..  Clearly  i^t)  ,%Zit))  has  the  property  thatt{t)?(t)  =  0, 
for  i=l,  2.  From  Definition  1. 1  it  follows  that  P^(T  -  T')  =  <^>  and 

Pt6Tptj^[  j  =  «|>  for  every  x  e  S(G,  u]  and  t  e  u.  This  implies  that 
the  triple  (0,<^,0)  is  an  admissable  state  decomposition  for  T  -  T'. 

From  Proposition  1  it  follows  that  T  -  T'  must  be  anticausal.  This 
means  that  +  T^  -  T^  -  T^  =  <f>.  From  Proposition  2. 4. 1  it  then 
follows  that  T^  =  T^  and  T^^  =  T^,  which  completes  the  proof. 

Interesting  corollaries  of  the  above  result  are  the  following. 

Corollary  4.  A  state  and  a  costate  decompositions  of  T  define  strongly 
causal,  strongly  anticausal  and  strongly  crosscausal  components  of  T. 

Corollary  5.  If  T  is  given  by  the  sum  of  a  strongly  causal  an-’  strongly 
crosscausal  system,  then  T  is  completely  defined  by  any  one  of  its  state 
decompositions. 

Corollary  6.  Suppose  that  (^t) ,  S,  C(t) )  and  (\S/(t) ,  S’,  ^’(t) )  are  state 
decompositions  of,  respectively,  T  and  T’.  If  ('^t) ,  S,  C(t) )  and 
(^(t),S’, C'(t))  are  strictly  equivalent^ then  T  and  T’  have  identical 
strongly  causal  and  stror.giy  crosscausal  component .s. 

Note  that  the  above  .statemeni.c  provide  >  'ts  v.hich  in  the 
context  of  linear  dyriamical  systems  arc  very  ianiil...; .  In  ,>articular 
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from  Corollary  7  we  obtain  that  two  strictly  equivalent  dynamical 
systems  have  the  same  weighting  pattern  [  65  ] . 

3,  5  Summary 

In  this  chapter  we  have  studied  some  interconnections  between 
the  causality  concepts  developed  in  Chapter  2  and  the  concept  of  state. 
Motivated  by  the  causality  development  of  Chapter  2,  it  was  natural  to 
embed  this  study  in  the  framework  of  group  resolution  space.  A  first 
order  of  business  was  then  to  formalize  a  meaningful  concept  of  state 
in  this  general  context. 

For  this  purpose  an  extension  of  the  state  decomposition  format 
of  Saeks  was  introduced.  As  a  partial  result  of  this  extension  our 
notion  of  state  satisfies  the  consistency  conditions  required  by  Zadeh. 
Moreover  it  permits  to  generalize  most  of  the  available  state-related 

results  which  are  usually  formulated  for  linear  systems.  This  leads, 
for  instance,  to  a  generalization  in  a  nonlinear  context  of  Propo.'ition 
2. 4,  2.  5  and  Theorem  2. 7  in  [  48  J . 

Meaningful  connections  between  state  and  causality  properties 
were  also  established.  These  results  give  a  rigorous  formulation  of 
the  heuristic  idea  that  whenever  a  system  has  something  special  with 
respect  to  its  state  structure  then  it  has  also  something  special  with 
respect  to  its  causality  structure.  In  particular,  this  is  illustrated 
by  Propositions  2.  3. 1-4.  The  conver.'se  is  also  true. 
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The  most  significant  result  of  the  chapter  is  given  by 
Theorem  3. 1.  This  theorem  states  that  the  strongly  causal  and 
stroi^ly  crosscausal  components  of  a  system  are  uniquely  defined  by 
any  one  of  its  state  decompositions. 


4.  CAUSALITY  PROPERTIES  IN  HILBERT 
RESOLUTION  SPACE 


4.1  Introduction 

Many  system  problems  in  communication  and  automatic  control 
have  natural  models  as  operators  on  a  Banach  or  a  Hilbert  space.  As 
these  spaces  cannot  be  viewed,  in  general,  as  group  resolution  spaces 
(GRS) ,  the  causality  results  in  Chapter  *1  are  not  directly  applicable. 

By  applying  appropriate  modifications,  most  of  the  development  in 
GRS  can,  however  be  extended  as  to  cover  operators  on  a  Banach  cr 
a  Hilbert  space.  The  main  objective  of  this  chapter  is  to  discuss  the 
nature  of  these  modifications  and  to  elaborate  on  the  type  of  results 
which  can  be  stated  in  the  new  context. 

To  achieve  this  objective  we  will  focus  attention  on  the  case  of 
systems  in  Hilbert  space.  This  will  permit  us  to  utilize  some  results 
recently  developed  by  mathematicians  of  the  Russian  school, 

[  24  J ,  [  25  ] .  At  the  same  time  we  will  be  able  to  illustrate  basic 
ideas  and  techniques  which  can  also  be  used  in  a  Banach  space  context. 
In  this  latter  case,  however,  a  more  cumbersome  and  complex  develop¬ 
ment  would  be  required  f  42  ] . 

There  are  several  procedures  by  which  the  causality  development 
of  Chapter  2  can  be  made  compatible  with  a  H'.bert  space  context.  To 
motivate  the  specific  character  oi  our  approach  it  is  helpful  to  first 
consider  two  simple  examples 
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Example  1.  Let  R  be  the  Hilbert  space  defined  by  ordered  n-tuples 
of  real  numbers  with  the  usual  inner  product.  Every  element 
X  =  {XjjXg, . . .  €  r”  can  be  viewed  as  an  element  of  the  GRS  des¬ 

cribed  in  Example  2. 2. 1  and  conversely  every  element  of  that  GRS 
can  be  viewed  as  an  element  of  r"-.  It  follows  then  that  all  the  causality 
co’*.cepts  and  results  presented  in  Chaptei*  2  are  valid  and  meaningful 
in  the  context  of  operators  on  the  Hilbert  space  r”. 

Example  2.  Let  £2  be  the  familiar  Hilbert  space  defined  by  ordered 

CO  rt 

sequences  of  real  numbers  (Xj^jXg, . . . )  such  that  V  x.  <  00.  The 

i=l  ^ 

space  £0  can  be  viewed  as  a  subset  ol  the  group  resolution  space 
S[  G,  v]  which  is  obtained  by  setting  G  =  R  and  =  {l,  2, . . . } .  More¬ 
over,  the  truncation  operators  p’  and  P.  associated  with  SfG,  v]  map 
^2  viewed  as  projection-operalors  on  ^2* 

The  causality  concepts  of  Chapter  2  can  be  applied  in  a  natural 
way  to  systems  in  ^2*  For  example  a  system  T  mapping^  2  ‘2 

can  be  called  causal  if, 

i  i  ^  ^ 

P  X  =  P  y  implies  P  Tx  =  P  Ty  for  all  x, V  i(  ^  and  i  e  v. 

The  other  causality  concepts  can  be  similarly  defined.  Note 
however  that  f'2  is  not  a  GRS.  This  implies  that  the  causality  results 
in  Chapter  2  do  not  necessarily  apply.  For  example  the  proof  of 
Theorem  3. 1  is  not  valid  in  f  2  and  the  questi.m  of  e>is(ence  of  a 
canonical  causality  decompo.sition  has  to  be  rfconsio-'  red 
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The  discussion  of  the  above  examples  illustrates  a  typical  ’’case 
by  case"  procedure  for  carrying  the  causality  study  into  a  Hilbert  space 
context.  This  procedure  is  quite  satisfactory  in  many  instances.  It 
implies,  however,  the  possible  need  for  a  r  ew  approach  to  suit  each 
specific  Hilbert  space.  The  desirability  of  a  unified  treatment  moti¬ 
vates  a  more  sophisticated  and  structural  approach.  This  leads  in 
turn  to  the  adoption  of  a  mathematical  setting  called  Hilbert  resolution 
space  and  to  a  causality  development  in  this  setting. 

A  few  comments  about  the  organization  of  this  development  are 
in  order.  Section  2  is  used  to  review  some  mathematical  preliminaries 
and  in  particular  to  define  Hilbert  resolution  spaces  and  some  related 
notions.  In  Sections  3  and  4  causality  Ci  s  and  properties  are 
discussed.  Some  closure  properties  of  systems  with  a  special  causa¬ 
lity  structure  are  considered  in  Section  5.  Section  6  deals  with  the 
question  of  causality  canonical  decomposition.  In  Section  7  the  treat¬ 
ment  is  specialized  to  weakly  additive  systems  in  Hilbert  space.  In 
Section  8  Hilbert  Schmidt  operators  are  discussed.  Finally,  Section  9 
reviews  some  highlights  of  the  chapter. 

4. 2  Hilbert  Resolution  Spaces 

In  this  section  some  basic  mathematical  concepts  and  definitions 
are  briefly  reviewed.  The  purpose  of  this  review  is  twofold:  to  clarify 
the  notational  machinery  used  in  the  following  sections  and  to  make  the 
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treatment  reasonably  self  contained.  A  unified  treatment  of  those 
standard  mathematical  concepts  and  definitions  which  are  needed  iii 
this  chapter  can  be  found  in  [  27  ],  [  41],  [  62].  For  the  concepts 
related  to  Hilbert  resolution  splaces  and  integrals  in  these  spaces 
the  reader  is  referred  to  [24],  [  25],  [42],  [  50]. 

The  reader  is  assumed  to  be  familiar  with  the  notions  of  metric 
spaces,  linear  spaces,  normed  spaces,  inner  product  spaces  and  the 
concepts  of  linear  and  nonlinear  mappings  in  these  spaces  (pe  for 
Example  [  27],  [  41],  [  62  ]) .  A  Banach  space  is  a  normed  linear  space 

which  is  complete  under  the  metric  induced  by  the  norm.  If  x'  is  an 

) 

element  of  a  Banach  space,  the  norm  of  x  is  indicated  by  the  symbol 
|x  I .  A  Hilbert  space  is  a  Banach  space  with  the  norm  induced  by  an 
inner  product,  i 

Suppose  that  T  is  a  mapping  on  a  Banach  space  B.  T  is  bounded 

II  i Tx 1  I  I  ' 

if  jTl=  sup  — J ^  <00.  If  T  is  bounded,  the  number  |T|  is  called 
O^xeB  |x|  ,  '  , 

the  norm  of  T.  T  is.  called  compact  if  T{F) ,  the  closure  of  the  image 

under  T  of  a  bounded  set  F  is  a  compact  set,  is  unbiased  if  T(0)  =  0. 

As  in  the  case  of  the  GRS  development,  we  will  only  consider  unbi  ased 

operators.  ' 

Suppose  that  H  is  a  Hilbert  space  and  v  an  ordered  set  with  t^, 
and  t^  respectively  minimum  and  maximum  elements*  of  u.  A  family 

r  ti 

IR  =  {P  I,  t  €  u,  of  orthogonal  projectors  on  H  is  called  a  Resolution 
of  the  Identity  if- 

*Ti  t  and  t  do  not  exist  the  definition  has  a  natural  extension 
(see,  for  instanc^  j  42]  p.  37), 
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Ri)  2  when  k  >  £;  k,  £  € 

^00 

Rii)  P  H  =  0,  P  H  =  H. 

The  projector  I  -  P^  will  be  de  ioted  by  P^.  A  pair  of  projectors 
s  k 

P  ,  P  e  IR,  s  >  k,  is  called  a  gap  in  IR  if  there  is  no  element  £  e  t' 
k  (  s 

such  that  P  c  P  c  P  .  IR  is  continuous  if  it  does  not  contain 

any  gap.  IR  is  closed  if  P  belongs  to  IR  whenever  there  exists 

•a  sequence  of  projectors  {P^}  in  IR  such  that  {P^}  converges 

strongly*  to  P.  The  Hilbert  space  H  equipped  with  IR  is  called  a 

Hilbert  resolution  space  (in  short:  HRS)  and  is  denoted  by  the 

symbol  [H,?V  In  the  sequel  we  suppose  that  IR  is  closed. 

The  parallelism  between  GRS  and  HRS  appears  quite  natural; 

indeed  using  ’’spectral  multiplicity”  theory  (see  Halmos  [  26  ]) ,  a 

HRS  can  be  viewed  as  a  modified  GRS  with  some  additional  structure. 

In  GRS  it  was  found  that  "sum  representation”  of  the  type 

Yj  dP(s)TP‘‘^,  etc. . were  essential  to  the  causality  development, 
se  i-’ 

In  a  HRS  context  the  notion  of  an  integral  can  play  an  equivalent  role. 

Suppose  that  T(s) ,  s  €  v,  is  a  family  of  operators  on  a  HRS 
indexed  by  s  €  t',  and  consider  the  following  operations: 

i)  Choose  a  partition  n  of  u,  a  =  •  •  • »  where 

^o  "  ^o’  %  "  *00  *  V  ^  set  of  elements 

in  .V  such  that  i;.  <  j=  1,  2, . . . ,  N- 1. 

"♦A  sequence“6roperators  {tJ  is  strongly  convergent  to  T,  if 
for  every  element  x  e  H  we  have  { T.x}  Tx. 
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ii)  Consider  the  partial  sum 


J  AP(k)T(s^) 
k=4 


N 


(4.1) 


^k-1 

where  AP(k)  =  P  _  p  *■  ?.nd  s  is  any  element  of  o,  such 

Jv 


iii)  On  the  set  of  all  partitions  n  of  v,  define  a  partial  order 

as  follows:  d  ^2  ^  every  element  of  ^^2  is  contained 

in 

iv)  Suppose  that  there  exists  an  operator  T  such  that  in 
correspondence  to  any  e  >  0  there  is  a  partition  of 
u  with  the  following  property:  the  operator  norm. 

I T  -  1  is  less  than  e  if  0  d  . 


The  operator  T  obtained  through  operations  i-iv)  is  called  the 
integral  of  the  family  T(s)  with  respect  to  IR  and  it  is  denoted  by 


T  =  /  dPT(s) . 


Slight  variations  of  the  above  concept  of  integral  are  also  of 
interest.  To  this  purpose  we  will  denote  by 

T  =  r(l  dP(s)  or  T  =  dPT(s) 

the  integral  which  is  obtained  by  choosing  in  operation  ii)  respec¬ 
tively  as  follows;  Sj^  -  j  or  Sj^  =  Similarly  the  operator 
T  =  /  dPT(s)  dP  will  denote  the  integral  which  is  obtained  by  replacing 
Equation  (4. 1)  in  operation  ii)  by  the  iollowing 


87 


1^*=  E  AP(j^)T(VAP(y. 
k=l 

Often  it  is  convenient  to  relax  the  condition  on  the  type  of  con¬ 
vergence  of  the  partial  sums  in  Equation  (4.1).  In  '^articular  it  may 
be  sufficient  to  require  that  in  step  iv)  uniform  convergence  be 
replaced  by  ’’strong  convergence”.  In  this  case  t»tep  iv)  would  have 
to  be  modified  as  follows:  "There  exists  an  operator  T  such  that  in 
correspondence  to  any  x  e  H  and  any  real  positive  e  >  0,  there  exists 
a  partition  of  v  with  the  following  property:  if  S2  >  then 

€  C 

|(T  -  I^^x|  <e”. 

In  the  course  of  this  development  it  will  oe  natural  to  associate 

with  an  operator  T  on  a  HRS  [H,  P^]  the  families  TP®  and  TP  .  These 

s 

families  will  lead  to  integrals  such  as 

/dPTP®,  i^dPTP®,  5^dPTP® 

and  similar. 

In  a  causality  context  this  type  of  integrals  were  first  applied  by 
Saeks,  [48] .  Their  rigorous  study  is,  however,  due  to  mathematicians 
of  the  Russian  school  ([  24  ] ,  [  25  j ) .  These  studies  are  documented  by 
a  large  number  of  results.  Only  a  few  of  these  results  will  be  needed 
here  and  they  are  listea  in  Appendix  B. 

For  later  use  and  to  gain  some  familiarity  with  the  abov3  defini¬ 
tions,  it  is  convenient  to  pause  and  consider  some  examples  of  HRS. 


Example  1.  Suppose  that  H  is  given  by  Lgl  0,  to)  ,  the  Hilbt  rt  space  of 
Lebe^ue  square  iategrable  comulex  functions.  In  0,  oo)  we  can 
define  a  family  of  ortht^onal  projection  operators  IR  =  (P^f ,  t  e  [0,  ao) , 
according  to  the  following  rule:  if  x  and  y  e  L2[0,  oo)  and  y  =  P^x,  then 
y(s)  =  x(s)  a.e.  in  [0,t]  and  y(s)  =  0  a.  e.  in  [t,  oo) .  The  family  IR  =  {P^} 
is  a  resolution  of  the  identity  because  it  enjoys  properties  Ri)  and  Rii). 
We  can  then  consider  the  HRS  [L2[0, «) ,  P*].  The  resolution  of  the 
identity  in  this  example  is  easily  shown  to  be  maximal  and  continuous. 

Example  2 .  Suppose  that  H  is  given  by  the  Hilbert  space  of  square 

summable  sequences  of  complex  numbers  (Xj^,X2, . . .).  In  f 2  can 

consider  the  family  of  orthogonal  projectors  IR  -  {P^j,  i  s  v=l,  2, . . . , 

where  each  P^  is  defined  as  follows:  if  x=(x^,X2,. . .),  y=(ypy2,***) 

e  £„  and  y  =  P^x,  then  y.=x.  for  j  >  i  and  y.=  0  for  j>i.  The  elements 
^  j  J  “  1 

of  the  family  DR  satisfy  the  properties  Ri)  and  Rii)  and  consequently 
DR  =  {P^}  is  a  resolution  of  the  identity  in  £2*  We  can  then  consider 
the  HRS  [  £^,P']  .  Observe  that  here  the  resolution  of  the  identity 
is  maximal  but  not  continuous. 


Example  3.  Suppose  that  H  is  given  by  L„[  0,  00)  £„.  This  means 

a  Ci 

that  a  typical  element  of  11  is  given  by  a  pair  (x^,X2)>  where  x^  is  an 
element  of  Lgf  0,  00)  and  X2  -  ^  element  of  £2* 

In  this  Hilbert  space  we  can  consider  the  family  of  projection  operators  {P^} 


defined  as  follows:  if  (Xj.Xg)  and  (yj,y2)  e  L2[0,qo)  x  and  (ypy2)  = 
P^(x^,X2),  then 


yj(s)  =Xj(s)  a.e.  in[0,j],  yj(s)  =  Oa.e.  in[j,oo) 


and 


^2i ""  ^2i  ^  S  j  ^21  =  0  ^0*“  i  >  3- 

Again  the  family  IR  satisfies  properties  Ri)  and  Rii)  and  therefore  is  a 
resolution  of  the  identity  in  L2  x  f  2-  We  can  then  consider  the  HRS 
[LgX  P^j.  Notice  that  in  this  case  the  resolution  of  the  identity 
is  neither  maximal  nor  continuous. 


From  the  above  examples  we  can  observe  that  Hilbert  resolution 
spaces  can  simultaneously  represent  those  continuous  time,  sampled 
data  and  hybrid  systems  which  are  usually  consii’<ired  in  automatic 
control  theory  (see  [  41]) .  More  complicated  and  less  familiar  systems 
in  communication  theory  can  also  be  embedded  in  this  framework.  In 
this  regard  the  reader  is  referred  to  [  17]. 

4.  3  Causality  Concepts  in  HRS 

The  basic  causality  concepts  which  were  introduced  and  discussed 
in  Section  2. 3  will  now  be  extended  into  the  HRS  context.  In  the  case  of 
causality,  anticausality  and  memorylessness  this  extension  is  straight¬ 
forward.  To  this  purpose  let  T  denote  an  (unbiased)  operator  on 
[H,  P*]  and  let  x  and  y  indicate  two  elements  in  [H,  P^]. 
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Definition  1.  T  is  causal  (anticausal)  if  P^x  =  pV  implies  P^Tx  =  P^Ty 
(P^x  =  P^y  implies  P^Tx  -  . 

Definition  2.  T  is  memory  less  if  it  is  simultaneously  causal  and 
anticausal. 

The  task  of  extending  the  concepts  of  crosscausality  and  strict 
and  strong  causality  is  not  as  straightforward.  The  difficulty  is  caused 
by  the  fact  that  in  GRS  these  concepts  were  based  on  the  notion  of  the 
evaluation  operator  dP(t) .  Usually  a  HR??  does  not  come  equipped  with 
this  type  of  operator.  This  is  the  case,  for  instance,  for  the  spaces 
considered  in  Examples  2. 1  and  2. 3. 

To  overcome  the  impasse,  observe  that  from  Propositions 
2. 3. 3-4- 5-6  the  causality  concepts  under  consideration  can  also  be 
based  on  the  notion  of  special  "sum-type”  representations.  This, 
together  with  the  heuristic  similarity  between  "sum-type”  and 
"integral- type”  representations,  leads  in  a  natural  way  to  the  fol¬ 
lowing  definitions. 

Definition  3.  T  is  strongly  causal  (strongly  anticausal)  if  T  is  causal 
(anticausal)  and 

/dPTdP  =  0  . 

Definition  4.  T  is  strictly  causal  (strictly  anticausal)  if 


T  =  dPTP^  (=  dPTP^)  and  /  dPTdP  =  0. 
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Definition  5.  T  is  crosscausal  if  /  dPTdP  =  0,  P^x  =  0  implies 
P^Tx  =  0  and  P^x  =  0  implies  P^Tx  =  0. 

Definition  6.  T  is  strongly  crosscausal  if 

ifidPTP®  =  ^dPTPg  =  /dPTdP  =  0. 

In  view  of  the  similarity  between  causality  concepts  in  GRS  and 
in  HRS,  most  of  the  considerations  and  physical  interpretations  in 
Section  2. 3  can  be  applied  in  the  HRS  context.  In  particular  it  is 
again  helpful  to  adopt  the  causality  alphabetic  code  P  =  {A,  C,  M,X, 

A,  C,  X,  A,  C} .  The  principle  of  causal  duality  also  remains  valid  and 
will  often  play  a  key  role  in  the  simplification  of  the  various  proofs. 

Principle  of  Causal  Duality  in  HRS  •  Let  a  statement  or  equality  be 
phrased  using  relations  involving  concepts  associated  to  the  alphabet 
fl,  families  of  projection-operators  such  as  P^  and  integral  trans- 
formators  of  the  type  |fi[[  ],  ].  Then  the  statement  or  equality 

remains  valid  if  the  following  interchange  in  symbols  occurs: 

C->A,  C^A,  C->A,  A-^C,  A-»C,  A-^C 

p^-^Pj,  P^->P*,  ]!(i— >  X— >x,  x->x. 

A  brief  discussion  on  the  implications  connected  with  the  choice 
between  strong  and  uniform  convergenc'*  for  the  integral  in  the  above 
definitions  is  in  order.  As  it  will  become  clear  in  the  course  of  our 


92 


development,  uniform  convergence  allows  greater  simplicity  in  the 
proofs  of  certain  results.  Occasionally  it  also  plays  an  essential 
role  for  the  very  existence  of  other  important  results.  Strong  con¬ 
vergence,  however,  is  often  preferable  from  a  physical  point  of  view. 
This  can  perhaps  be  best  illustrated  by  a  simple  example. 

Example  1.  Consider  the  HRS  described  in  Example  2. 1.  A  system 
T  on  this  HRS  maps  every  element  x  e  L2[  0,  jo)  into  an  element 
y  e  L2[  0,  oo) .  Suppose  that  T  is  defined  as  follows:  if  y  =  Tx  then 

y(t)  =  x(t  +  Tj)x(t  +  Tg) 

where  Tj  and  t2  are  real  numbers  and  x(s)  =  0  whenever  s  <  0. 

The  system  under  consideration  is  formally  identical  to  that 

considered  in  Example  2.  3. 1.  As  in  that  example,  the  causality 

character  of  T  is  a  function  of  the  location  of  the  point  {jp  in  the 
2 

Cartesian  plane  R  .  In  particular,  for  Tj  <  0  and  T2  <  0  it  is  easy  to 
verify  that  T  is  causal.  Similarly  for  >  0  and  T2  >  0  T  is  anticausal, 
and  for  Tj  =  0,  T2  =  0  T  is  simultaneously  causal  and  anticausal,  hence 
memoryless. 

When  the  convergence  of  the  integrals  in  definitions  3-6  is  in¬ 
tended  in  the  strong  sense  then  the  causality  structure  of  T  as  a  function 
of  (tj,  T2)  can  be  a  subject  of  further  analysis.  For  instance,  if  <  0 
and  T2  >  0,  then  in  addition  to  TP*  =  P*TP*  and  Tl^  = 
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/dPTdPx  =  0  for  every  x  c  L2[  0,  oo) .  This  implies  that  T  is  cross- 
causal.  More  specifically  T  is  strongly  crosscausal  because  we 
also  have  that 

iJdPTP^x  =  ^dPTP  X  =  0. 

s 

Similarly  for  <  0  and  Tg  <  0  we  can  verify  that 

Tx=  ^dPTP®x 

and  therefore  T  is  strictly  causal.  Proceeding  in  this  way  we  obtain 
that  the  causality  character  of  T  is  identical  to  that  described  in 
Example  2. 3. 1.  In  particular  the  results  illustrated  in  F^^e  2. 1 
are  again  true. 

It  is  important  to  observe,  however,  that  in  the  case  of  uniform 
convergence  not  ail  of  the  above  results  hold  and  the  analysis  becomes 
somewhat  less  responsive  to  our  expectations.  For  instance,  for 
Tj  <  0  and  Tg  <  0  T  would  not  be  strictly  causal  because  (in  the  case 
of  uniform  convergence  it  is  no  longer  true  that  T  =  ^dPTP®. 

Similarly  when  <  0  and  Tg  <  0  T  would  not  be  crosscausal. 

To  conclude  the  section  the  following  remark  is  in  order.  Results 
and  considerations  in  this  chapter  remain  formally  identical  whether 
strong  or  uniform  convergence  is  adopted.  Thus,  the  adoption  of  uni¬ 
form  convergence  has  to  be  considered  as  a  matter  of  mere  technical 
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convenience.  The  situation  is  somewhat  different  in  the  next  chapter. 
In  that  context  the  use  of  uniform  convergence  is  essential  and,  if 
strong  convergence  is  adopted  instead,  then  the  results  of  that  chapter 
do  not  hold. 

4.4  Causality  Properties  of  Basic  Systems  in  HRS 

From  the  similarity  between  the  definitions  of  causality  concepts 
in  GRS  and  those  in  HRS,  it  is  natural  to  expect  that  properties  similar 
to  those  already  seen  in  GRS  might  also  be  stated  in  the  HRS  context. 
To  illustrate  that  this  is  the  case,  we  will  revisit  some  of  the  results 
in  Sections  2. 4  and  2.  5.  For  brevity  our  attention  will  be  confined  to 
those  results  which  will  be  needed  later  in  the  development. 

To  start  with,  the  following  Propositions  1  and  2  are  similar  to 
Propositions  2.4. 1  and  2. 4.  2.  These  results  have  already  appeared 
in  the  technical,  literature  f  43]  [  48].  As  the  present  mathematical 
setting  is  slightly  different  from  that  adopted  in  those  references,  a 
brief  review  of  the  proofs  is  included. 

Proposition  1.  The  following  statements  are  equivalent: 

a)  T  is  causal 

b)  P*^T  =  P^TP^ 

c)  T=I^dPTP®. 


to  that  seen  in  the 
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Proof,  a) — >h)  .  The  argument  is  formally  identicaj 

proof  of  Proposition  2. 3. 1.  b) - ^  c) .  Suppose  that  T  is  causal. 

Then  for  any  partition  0  =  {t^=  . . . ,  t^}  of  v  the  following 

relations  hold 

N  N  ^  N  L 

T=  y  AP(|.)T=  JaPU.)?  't=  VaPU  )TP  \ 

1=1  ^  i=l  ^  1=1  ^ 


Hence  T  =  5^  dPTP®.  c) - >  a) .  Suppose  that  c)  holds  and  choose 

any  x,  y  e  H  and  t  €  i*  such  that  P^x  =  pV*  Then  we  have 


P^Tx  =  pV  dPTP®x  =  5(!pWpVx  =  P^dPTP®pV  =  pV- 


This  implies  that  T  is  causal. 


Proposition  2.  The  following  statements  are  equivalent: 

a)  T  is  memoryless 

b)  P^T  =  P^TP*  and  P^T  =  P^TP^ 

c)  T=  /dPTdP  . 

Proof.  The  equivalence  of  a)  and  b)  is  a  direct  consequence  of  Propo¬ 
sition  1  and  its  dual.  It  is  then  sufficient  to  prove  the  equivalence 
between  b)  and  c) . 
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b)  — >  c) .  Suppose  that  b)  holds.  Observe  that  for  every  parti¬ 
tion  «  =  {tj,  =  ,  In  = 

N 

T  =  X  AP(|  )T. 
i=l 

Applying  b)  we  obtain  that  for  each  i  the  following  relation  holds 

|.  I- 

AP(| .)  T  =  AP(|.)P  ^P,  T  =  AP(|  )  TP^’t, 

1  ^  ^i-1  ^  ^i-l 


-  AP(|.)TAP(|.). 

It  follows  that  for  every  partition  fi  of  N  we  can  write 

N 

T=  J  AP(5  )TAP(«  ). 

This  implies  c) . 

c)  — > b) ,  For  any  t  e  i'  and  any  partition  f2  =  -1^,  Ip  •  •  • ,  Ij^ 

such  that  t  e  n,  we  have 


p‘  j  AP(|  )TAP(4j)  =  P‘  2  AP(?j)TAP({j)P* 
i=l  i=l 

and 

N  N 

P,  I  ArUOTAP(U=P.  V  AP({i)7AP({  )H. 
1=1  1=1  ^ 

If  c)  holds,  the  above  equation  implies 

P^T  =  P^TP^  and  P^T  ^  P^TP^ 


thereby  completing  the  proof. 


<3 
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The  next  proposjtion  is  analc^ous  to  Proposition  2. 4.  5.  The 
proof  is  based  on  techniq[ues  similar  to  those  adopted  in  Propositions 
1  and  2  and  will  be  omitted  for  brevity. 

Proposition  3.  The  following  statements  are  equivalent: 

a)  T  is  crosscausal 

b)  TP^  =  jdPTdP  =  0 

c)  ^dPTP®  =  ?ftdPTPg  =  /dPTdP  =  0. 

Techniques  similar  to  those  adopted  in  the  proofs  of  Propositions 
1  and  2  can  also  be  applied  to  obtain  results  of  the  type  illustrated  in 
Section  2.  5.  In  this  regard  we  introduce  the  following  two  propositions. 

Proposition  4.  If  T  is  strongly  causal  (strictly  causal)  and  T"  is 
causal  then  T’T*'  and  T’'T’  are  strongly  causal  (strictly  causal) . 


Proof.  If  T’  is  strongly  causal  then  by  definition  T’  is  causal  and 


/dPTdP  =  0 . 


(4.2) 


Since  T"  is  also  causal  we  can  apply  Proposition  1  and  obtain 


P^T’T"  =  P^t*P^T"  =  p^'r'X'*p^ 


Applying  again  Proposition  1  this  implies  that  T’T”  is  causal. 

To  prove  that  T’T”  is  strongly  causal  it  remains  to  be  shown 
that  /dPT'T”dP  =  0. 


J 


98 


Given  any  partition  S2  of  i/,  Si  =  =  ?q»  •  •  • » 

! 

the  causality  of  T’  and  T"  the  following  relations  hold 

AP(|.)T’=  APa.)T’P 

T**AP(eJ  =  P.  t"AP(^) 

‘  ^i-1 

fc:  1,  2,  .  .  .  ,  N. 

It  follows  that  for  each  i=  1,  2,  < . . ,  N  we  have 
AP(^.)T'T”AP(|.)  = 

V 

=  AP(?.)T’P  T,/  T"AP(^)  = 

^  ^i-1 

,  =  AP(^,)T'AP(4.)T"AP(^.) 

1  '  '  , 

and  from  here 

N  N 

j  APU  )T’T»AP(|j)  ^  X  AP(^pT’AP(,^pT”APU.). 
i=l  ,  i=l  , 

It  follows  that 

I  j  AP(^.)T'AP(^)T"AP(|.)  I  <(sup  |aP(^.)T’AP(^P  1  |T"| 

i:rl  .  ^ 

(4.3) 

and  from  Equations  (4.  2)  and  (4.3)  it  follows  /dPT'T"dP  =  (!>.  Similarly 
for  T”r’. 

Suppose  now  that  T'  is  strictly  causal.  It  has  to  be  sholvn  that 
T'T"  is  strictly  causal.  From  the  definition  of  strict  causality  and 
Propo"ltion  1  the  following  relations  hold 
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T’  =  ^dPT'P®  and  T”  =  l^dPT'T^. 

From  the  definition  of  integral,  given  any  6  >  0,  two  partitions  and 
can  be  found  such  that  for  all  partitions  $2,  d  u  (2", 

J2  =  I  j, . . . ,  the  following  relations  hold 

|T'-T’|<e  and  |T"-T”|<e  (4.4) 

where 

N  ^  ^  N  ^ 

f-=  J  AP{^pT’P  '"^andT’'=  Yj  APU.)T”P  \ 
i=l 

From  Equation  (4. 4)  it  follows  that 

|rT"-T'T"|  <|T'-f'|  |T-'|  <«  |T"| 
and 

|f»T"  -  TT”!  <  |T’|  €  <(|T’|  +€)  e. 


From  here  we  obtain 


IT-t”  -  <{|T'|  +  |T"|  +€)  €.  (4.5) 

But  we  also  have 


N  1 

y  AP(^)T’T"P  ^ 
i=l 


(4.6) 


and  from  Equations  (4.  5)  and  (4.6)  and  the  definition  of  integral  it 
follows 


T’T"=  r/idPT'T"P®. 


100 


It  can  then  be  concluded  that  TT”  is  strictly  causal, 
ment  would  show  that  T**T’  is  also  strictly  causal. 


A  similar  argu- 
<] 


Proposition  5.  If  T  is  simultaneously  and  with  €  {A,  C,  M, X}, 
then  either  =  Cg  or  T  is  the  null  operator. 


Proof.  Suppose,  for  instance,  that  T  is  simultaneously  A  and  C.  From 
Definition  2.4. 3  and  Proposition  1  we  must  simultaneously  have 


t  *1 

P^T  =  P"TP‘ 

(4.7> 

T  =  i^dPTPg 

(4. 8) 

/dPTdP=  0. 

(4.9) 

>•9 


t 

i 

I 

! 


i 

i 

\ 


} 


From  Equation  (4.  8)  it  follows  that  for  any  €  >  0,  there  exists  a  parti¬ 
tion  such  that  for  any  other  partition  n  =  {|^  =  t^,  =  t^}, 

£1  D  £1^ ,  the  following  relation  holds 

N 

I  y  )TPj  -  t|  <e. 
i=l  ‘  ^i-1 

But  from  Equation  (4.  7)  we  obtain 

N  N 

I  AP(^)TP,  =  I  AP(«  )TAP(?  ). 
i=l  ^i-1  i-l 


This  means  that  given  any  €  >  0  we  can  find  a  partition  such  that  for 
any  other  partition  n  3  we  have 

N 

I  I  AP(| j)  TAPi^ j)  -  t|  <c. 
i=l 
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This  implies  T  =  /dPTdP  and  from  Equation  (4. 9)  T  must  be  the  null 
operator.  The  proof  for  the  other  cases  is  similar  and  will  be  omitted. 


In  view  of  the  above  results  the  containment  relations  among  the 
various  classes  of  systems  with  a  basic  causality  structure  are  identical 
to  those  already  discussed  in  a  GRS  context.  In  particular  the  pictorial 
:  ^presentation  in  Fi^are  2. 2  is  also  valid  for  systems  defined  in  HRS. 


4.  5  Some  Closure  Properties 

The  set  of  all  bounded  operators  mapping  a  HRS  into  itself  can, 
in  a  naniral  way,  be  viewed  as  a  linear  and  nurmed  space  Moreover, 
it  is  easy  to  verify  that  ^  is  complete  under  the  metric  induced  by  the 
operator  norm. 

The  various  sets  of  systems  with  a  basic  causality  structure  can 
also  be  viewed  as  linear  normed  spaces.  These  spaces  are  subspaces 
of  ^  and  the  natural  question  arises  whether  they  too  enjoy  the  com- 
pleteness  property.  From  the  completeness  of  ^  this  is  equivalent  to 

determine  whether  the  limit  of  a  convergent  sequence  of  olJerators 
which  are  aeR  is  a  a  operator.  In  this  regard  we  can  state  the 

following  results. 


Proposition  1.*  The  subspace  of  bounded  causal  operators  *s  complete. 

Proof.  Suppose  that  {T.}  is  a  convergent  sequence  of  bounded  and 
causal  operators  and  (tJ  — >  T.  We  have  to  show  that  T  is  causal. 

♦ 

A  result  of  this  type  has  been  already  established  in  the  technical 
literature  (see  for  example  [48]). 
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By  Proposition  4. 1  this  is  equivalent  to  show  that  given  any  pair 
(y>  >  y  c  teVf  the  following  relation  holds 

P*Ty  =  pVpV- 

This  can  be  done  showing  that  for  any  positive  e  >  0  the  following 
expression  holds 

|p^Ty  -  P^TpVI  <€. 

To  this  purpose  chiiose  an  integer  N  such  that 

|T-T„|<— (4.10) 
N  '  rt  I  I 

2|yi 

Since  T.t  is  causal  it  follows 
N 

P\y-P\p\.  (4.11) 

From  Equations  (4  10)  and  (4. 11)  the  following  relation  holds 

|P*Ty  -  p‘tpV|  =  |p‘Ty  -  P^T^y  +  p‘TjjPV  -  P*TpV|  < 

,  t  it  t  1  t  e 

<|p‘(T-T^,)y|  +  |P^Tj.-T)p'y|<2  —  — =  «• 

|yi  |y| 

It  can  then  be  concluded  that  T  is  causal  and  the  proof  of  the  theorem 
is  thus  complete, 

Proposition  2.  The  subspace  of  bounded  strongly  causal  operators 
is  complete. 
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Proof.  Suppose  that  {T.}  is  a  convergent  sequence  of  bounded  and 

strongly  causal  operators  and  {T.}  — >  T.  By  Proposition  1  T  is 

causal  and  it  remains  to  be  proved  that  /dPTdP  =  0.  To  this  purpose 

it  has  to  be  shown  that  for  any  e  >  0,  a  partition  of  v  can  be  found 

such  that  it  enjoys  the  following  property:  M  SI  =  (t^  =  ?  j, . . . ,  ^ t^ 

is  any  other  partition  of  v  and  S2  d  S2^ ,  then 

N 


I  AP({  )TAP(?  )  I  <e. 
j=l  >  > 


Let  i^  be  an  integer  such  that 


Tj-T|  <f. 
o 


(4. 12) 


(4. 13) 


Since  T.  is  stroi^ly  causal  there  exists  a  partition  ci  v  U  such  that  if 
0  ^ 

S^  =  {tg  =  •  •  • ,  I  t^}  and  SI  D  then  the  following  relation 

holds 

N 

I  ^AP(?.)T.^AP({.)| 

From  this  equation  it  follows  that 

N  N 

I  I  AP(|  )TAPa  )  1=12;  AP(5  )(T  -  T,  )AP(?  )  + 
j=l  j=l  •*  0 

N 

I  AP(|  )T  AP(5  )  I  < 
j=  1  '*0 


N 


N 


<  I  I  -^Pa^XT  -  T  )  AP({  )  1  +  12^  AP({  )T.  AP({.)  I  . 
j=l  ^  0  J  j=l  J  o  J 

(4. 14) 
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Moreover 

N 

I  I  AP(U(T  -  T  )  AP({,)  I  =  s^|aP({  )(T  -  Tj  )  AP«  )  |  <  |T  -  T 

j=l'*  0^3  *  o  *  o 

From  here  and  Equaticms  (4. 12) ,  (4. 13)  and  (4. 14)  it  follows  that 
for  2 12^  the  following  holds 

||^AP«.)TAP«.)|<-|-^-|-=e. 

At  this  point  it  can  be  concluded  that  T  is  strongly  causal  and  the  proof 
is  thus  complete. 

Proposition  3.  The  subspace  of  bounded  and  crosscausal  operators  is 
complete. 

Proof.  We  have  to  show  that  if  {T^}  is  a  sequence  of  bounded  cross- 
causal  operators  and  {T^}  T^,  then  is  also  a  crosscausal  opera¬ 

tor.  Since  each  element  of  the  sequence  {tJ  is  crosscausal,  from 
Definition  3.  5  wo  have  that  whenever  T  =  Tj  the  following  equations 
are  satisfied 


TP*  =  P*TP* 

(4.15) 

TP^  =  P^TP^ 

(4. 16) 

/dPTdP=  0. 

(4. 17) 

We  have  to  prove  that  Equations  (4. 15) ,  (4. 16)  and  (4. 17)  are 
also  satisfied  for  T  =  T^.  Let  us  start  to  show  that  for  any  c  >  0  we 


have 
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It  -  pS*  p^I  <£. 

*0  c  * 

To  this  porp  jse  choose  an  integer  i^  such  that 

|T-T  I  <4-  . 
o 

We  Aan  then  write 

|T  P^-  P*T^P*|  <  |TqP*-  Tj  P^I  +  |t.  P*-  P*T^p‘|  <  2|t  -  T.  |  <e. 

o  o  o 

From  the  arbitrarity  of  €  it  follows  that  Equation  (4. 15)  is  true  for 

T  =  T^.  By  the  principle  of  causal  duality  also  Equation  (4. 16)  is 

true  for  T  =  T  To  complete  the  proof  we  have  to  show  that  J dPT^dP  =  0. 

Given  ai^  e  >  0  consider  the  integer  i  such  that  jT  -  T.  |  <4-.  Since 

o  ‘o 

T.  is  crosscausal  there  exists  a  partition  A  of  v  such  that  for  any  other 
1  € 

0 

partition  «={?<,  =  ‘o’  ^  1>  •••’  “  *oc.^’  **  2 

I  f  AP«j)T  AP«,)  I  <\. 
i=l  o 

This  implies 

max  |ap(5  )T  0P(4 )  I 

1  '  11^  I  '  2 

From  here  we  obtain  the  following 

m^  |aPUj)T^AP(|.)  I  <m^  |aP(^.)(T^  -  T.  )  AP(|  )  |  + 

^  ^  o 

+  m^  |aP(|.)T.  AP(^)  I  <6. 
i  o 
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It  foUovs  that  for  S2  d  we  have 

N 

I  I  APtt,)TAP({j)  I  <e. 

h=l 

We  can  then  conclude  that  /dPTdP  =  0  thereby  completing  the  proof.<[^ 

From  the  above  results  we  can  conclude  that  each  one  of  the 
sabq[iaces  under  consideration  can  be  viewed  as  a  Banach  space.  As 
these  subspaces  also  enjoy  the  property  of  being  closed  under  the 
operation  of  composition  of  operators,  we  can  state  the  following 
theorem. 

Theorem  1.  The  subspace  of  bounded  causal  (strongly  causal,  cross- 
causal)  operators  is  a  Banach  algebra. 

Observe  that  in  the  particular  case  of  linear  and  causal  operators. 
Theorem  1  gives  a  result  which  was  alreacfy  stated  by  Saeks  in  [  48  J 
(see  Proposition  3. 1) . 

4  6  Canonical  Causality  Decomposi«^ion  ill  llXIrD 

in  anal(^  with  the  causality  envelopment  for  systems  defined  on 
a  GRS  it  is  natural  at  this  point  to  ask  whether  a  system  on  a  HRS  might 
be  represented  by  the  sum  of  systems  of  type  a  e  (A,  C,  M,  X} .  This 
representation  will  be  again  called  a  canonical  causality  decomposition 
and  to  investigate  its  existence  we  will  use  an  approach  similar  to  that 
adopted  in  Section  2.6,  To  start  consider  the  following  result. 
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Proposition  1.  If  T  has  a  cammical  decomposition  then  this  decompo¬ 
sition  is  unique. 


Proof.  Suppose  that 


holds  where  {T^,  T^,  T^,  T^}  and  T^,  T^,  T^}  are  two  distinct 


-V  ‘C*  M* 


canonical  decompositions.  Then  it  also  holds  that 


Since  Tjy|  -  is  memory  less  we  can  apply  Proposition  4.  2  and  obtain 

-  Ta  -  T;,  -  .  Ti  -  T^JdP 


=  /dP[T;^  -  T^JdP  +  /dP[T^  -  T^]dP  +  /dPlT^.  -  Ty]dP 


C 


‘X  x^ 


By  Definitions  4. 3. 3  and  4. 3. 4,  each  term  on  the  right  hand  side  of  the 
above  equation  is  null.  It  then  follows  that  Tj^  = 

Proceeding  in  a  similar  way 


and  applying  Proposition  4. 1  we  obtain 


=  ?^dP[T^  -  T^]P®  +  l)^dP[T;.  -  TjP®. 


A  "A 


X  ‘X-* 


Obc^rve  that  by  Definition  4.  3. 4,  5^dPfT^-  Tx]P  =  0  and  by  inspection 
pi  v?f  -  T^]  P®  =  /dP[  '  T  J  dP  =  0.  It  follows  then  that 
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Aiqplying  the  principle  of  causal  duality  it  follows  that  j 

and  from  this  it  follows  also  that  =  T^.  We  can  then  conclude  that  j 

^  '  A*  ’^C*  ^**’a*  '^’c*  ’’^M’  ^  distinct.  This 

implies  that  if  T  has  a  canonical  causality  decomposition  then  this 
decomposition  must  be  uniqiue. 

In  analogy  to  Definition  2.6. 1,  when  T  has  a  causality  canonical 

decomposition  T  =  T .  +  +  T„  +  T.^,  we  will  refer  to  T T_,  T.^ 

A  C  M  X’  A*  C  M’  X 

as  the  canonical  components  of  T. 

To  deal  with  the  question  of  existence  of  such  a  decomposition  it 

is  convenient  to  use  again  the  notion  of  'transformator**.  Indicating 

by  $  the  space  of  all  operators  on  a  iRS  we  will  say  thatX  is  a 

transformator*  if  T  is  an  operator  mapping  $  into  itself.  T  will  | 

be  denoted  by  "T  ,  a  e  {A,  C,  M,  x}  if  for  each  T  e  $  we  have  that  i 

^  ~  ~  } 
T*  [Tj  is  an  a  operator.  As  examples  of  transformator s  we  can  j 

I 

mention  some  of  the  integrals  defined  in  Section  4.3.  In  this  case  j 

j 

the  terminology  of  integral  transformator s  is  adopted.  With  the  | 

above  setting  we  can  now  state  a  result  similar  to  Proposition  2.  6. 

J 

Proposition  2.  T  has  a  canonical  causality  decomposition  if  and  only  ; 

i 

if  T  is  in  the  domain  of  the  set  of  transformator s  defined  as  follows  ) 


*This  terminology  is  borrowed  from  Gohberg  and  Kroin  [251. 


T^[T]  =  /dPTdP 
t:^[t]=  !fdP[T-Tj;,[T]]p® 

'T^[T]=  ^dP[T-1J,[T]jP® 

Proof.  ’’Only  if**.  Suppose  that  T  has  a  causality  canonical  decompo¬ 
sition.  Then  we  can  write 


T  = 


From  here  it  follows  that 


and  applying  Proposition  4.  2  we  obtain 


Tm=  /dPTdP-  /dPT^dP-  /dPT^dP 
-  /dPT^dP. 

Applying  Definitions  4. 3. 3-.  6  we  obtain  that  Tj^  =  and  there¬ 

fore  T  is  in  the  domain  of  the  transfurmator  Proceeding  in  a 

similar  fashion  we  can  also  obtain  that  T  is  in  the  domain  of  T .  TC 

A’  C 

and*^. 

**if".  Suppose  that  T  is  in  the  domain  of  the  above  integral 
transformators.  Then  it  is  immediate  to  verify  that 
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T  =t;(t]  +t^[t]  +t;;,[t]  +-!^[t]. 

By  a  direct  application  of  the  causality  definitions  we  can  now  recc^nize 
tten^!T],T^[T),T;;,[T)  aiKt^fT]  are  respectively  A,  C,  M  and  X. 

This  completes  the  proof. 

The  statements  of  Propositions  1  and  2  can  be  combined  in  the 
following  theorem. 


Theorem  1.  If  T  has  a  canonical  decomposition  then  this  decomposition 
is  unique  and  its  components  can  be  computed  as  follows; 

Tm  -  /dPTSP,  =  l^dP'T  -  Tj,|P^ 

To  illustrate  some  implications  of  Theorem  1  v/e  pause  for  a 
moment  and  discuss  tv;o  simple  examples. 


i- 

Example  1.  Consider  [^^[Ojoo),?  ],  the  Hilbert  resobition  space  des¬ 
cribed  in  Example  4.  2. 1  and  suppose  that  T  is  described  as  follows; 
if  y,x  e  l-'2[0>  y  =  Tx  then 

OD  00 

y(t)  =  /  /K(t,  Sj,  S2)x(sj)x(s  'dSjdSg 

GO 

where  k(tj,  Sp  s^)  is  a  real  function  such  that 


n  00  00  00  n 

QkG  -  /  /  /K^tpSpSjdtdSjdSg  <00 


0  0  0 


Note  that  from  a  simple  applicativ^n  of  Fubi^/  i’s  theorem  [  27  ],  we 
have  / 


|y|^  <  DkQ"'  N 


4 


't 

/ 

t 


/ 

/ 


(4.  18) 


Ill 


Observe  also  that  T  can  be  written  as  T  =  +  Tg  +  Tg,  where  T^,  Tg 

and  Tg  are  described  as  follows; 

t  t 

y=TjX  implies  y(t)  =  j  j  K(t,  Sp  Sg)x(si)x(Sg)dSjdSg 

00  00 

y  =  TgX  implies  y(t)  =  ^  ^  K(t,  s^,  Sg)x(Sj)x(Sg)  ds^dSg 

^  00 

y=  TgX  implies  y(t)  =  /  f  K(t,  s^  S2)x(S;i)x(Sg)dR^ds2 

O  V 

00  t 

4  f  /  K(t,  Sj^,  Sg)x(Sj)x(3g)dSjdSg. 

L  O 

From  standard  arguments  of  real  analysis  based  on  the  validity  of 
Equation  it  is  not  difficult  to  verify  that 

/dPTdP  =0,  Tj  =  i(idPTP®  Tg  =  I^dPTPg 

where  the  integrals  are  intended  in  the  strong  sense.  Applying  Theorem 
1  we  can  comjlude  that  T  has  a  unique  canonical  causality  decomposition. 
The  basic  components  of  this  decomposition  are  as  follows:  Tj^  =  0, 

^a;:  T2“''Tx=T3.  <] 

Example  2.  Consider  again  f  Lgf  0,  qo)  ,  P^]  and  suppose  that  T  is  des¬ 
cribed  as  follows:  if  y,  x  €  L2[  0,  oo)  and  y  =  Tx  then 

00 

y(t)  =  Kj(t,  s)x(s)ds  4 

00  00 

^  /  KgCt,  s^,  S2)x(Sj)x(s2)  dSjdS2  + 


00  00 

•o  ’  .^Kj^(t>Sl»---Sn)x(Sj)x(s2)...x(s^)dSjds2.  ..dSj^ 
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where  K.(t,  . . . ,  is  a  real  function  such  that 

^  ^  ^1’  ^2*  ’  ‘  dSjQSg- . .  dsj  ^  00 

for  i=l,  2, . . .  n.  Note  that  this  type  of  operators  are  called  Frechet- 
Volterra  and  have  been  extensively  utilized  in  the  information  and 

automatic  control  literature  [  1  ],  [28  ],  [35  ],  [  46  ]. 

1 

Using  a  line  of  reasoning  similar  to  that  in  Example  1,  we  can 
again  see  that  T  has  a  canonical  causality  decomposition.  In  this 
decomposition  the  memoryless  component  is  null  and  T^,  and 
T  ,  respectively  strongly  causal,  strongly  anticausal  and  strongly 
crosscausal  components  of  T  can  be  idehtifed  as  follows.  Let 

n  t  t  ' 


,  spx(sj)x(s2) .  ^x(s.)  dsjdsg. .  .ds^ 


/^  •  •  •  ^i^*>  ®1»  ®2'  •  • 


s.)x(spx(s2) .  .,.x(s.)  dSjdSg. .  .ds 


yx=T^-v- V  <! 

Theorem  1  links  the  study  of  existence  of  a  causality  canonical 
decomposition  to  the  study  of  the  convergence  properties  of  a  special 
class  of  integral  transformators.  This  latter  study  has  recently 


t 
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received  attention  from  a  number  of  mathematicians  from  the  Russian 
school.  Of  particular  interest  here  is  the  work  of  Gohberg  and  Krein 
[24],  [25]. 

A  result  of  this  study  with  negative  implications  for  the  canonical 
decomposition  is  that  t^ese  integral  transfer mators  suiter  from  con> 
vergence  problems.  To  emphasize  this  the  following  proposition  is 
noted. 

Proposition  3.  There  exists  systems  T  on  a  HRS  which  do  have  a 
canonical  decomposition. 

Proof.  It  suffices  to  present  an  example  operator  for  which  at  least 
one  of  the  integral  transformators  in  question  fails  to  exist.  The 
reader  is  referred  to  Appendix  B  for  some  preliminary  results  in 
this  direction.  In  particular  from  Lemma  B.  5,  we  have  that  for 
every  HRS  with  a  continuous  resolution  of  the  identity  there  exists 
a  compact  self-adjoint  operator  T  such  that  /  P®TdP  is  not  defined. 
From  Lemma  B.  4  it  follows  that  /  dPTP®  is  also  not  defined. 
Moreover  applying  Lemma  B.  1 

T^.  =  /  dPTdP  =  0 
M 

and  applying  Lemma  B.  2 

J  dPTP®  =  ^ftdPTP®  =  l^dP[T  -  Tj^jJP^. 


From  the  fact  that  f  dPTP^  is  not  defined,  it  can  be  concluded  that 
^dP(T  -  T|^)  is  also  not  defined.  It  follows  that  such  a  T  does  not 
have  a  canonical  decomposition. 

4. 7  Causality  and  Weakly  Additive  Operators  in  HRS 

The  importance  of  weakly  additive  operators  was  already  out¬ 
lined  in  Section  2. 7.  In  the  sequel  the  development  of  that  section  will 
be  revisited  in  a  HRS  context. 

Definition  1.  An  operator  T  on  [  H,  P^J  is  weakly  additive  if  for  every 
X  £  H  and  all  t  e  v  the  following  relation  is  satisfied 

T[x]  =  T[P^xJ  +  T[P^x]. 

Before  proceeding  with  a  causality  study  of  weakly  additive  opera¬ 
tors,  it  may  be  helpful  to  consider  some  examples.  To  this  purpose  we 
introduce  the  following  proposition. 

Proposition  1,  The  following  operators  are  weakly  additive. 

i)  every  linear  operator 

ii)  every  memory  less  operator 

iii)  the  linear  combination  of  weakly  additive  operators 

iv)  the  composition  T"T’  where  T'  is  weakly  additive  and  T"  is 
linear 

v)  the  composition  T"T’  where  T'  is  memoryless  and  T"  is 


weakly  additive. 
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Proof,  i)  and  iii)  are  trivial,  ii)  Suppose  that  T  is  memoryless. 

Then  for  any  t  6  i/  and  x  €  H  the  following  relations  hold: 

P^Tx  =  P|TP^x,  that  is  P*TP*  =  0,  and 

P^Tx  =  P*TP*x,  that  is  P*TP^  =  0. 

It  follows  that  for  slit  e  v  and  x  €  H,  we  have 

Tx  =  P*Tx  +  P^Tx  =  P*TP*x  +  P|.TP^x  =  TP^x  +  TP^x. 

iv)  For  all  t  €  v  and  x  e  H  the  following  relations  hold 

T’T’x  =  T”[T'P*x  +  T'Ptx]  =  T’T’P^x  +  T"T’P^. 

v)  Again  for  all  t  e  i/  and  x  e  H  we  have 

T’T'x  =  T"[T'Px  +  T'PjX]  =  T"[p‘t'P*x  +  P^TT^x] 

=  T"lP*T’x  +  PjT'x]  =  T"P*T'x  +  T’TjT'x  = 

_  'p*’p^'p*P^x  +  T**P  T*P  X  =  T**T*P^x  +  t**T*P  x. 

t  t  t 

We  can  conclude  that  T'T'  is  weakly  additive. 

Most  of  the  causality  properties  which  were  stated  in  the  case  of 
weakly  additive  operators  in  a  GRS  are  also  valid  in  the  case  of  weakly 
additive  operators  in  a  HRS.  More  specifically,  the  statements  of 
Propositions  1,  2, 3,  and  4  in  Section  2. 7  hold  ’’almost  verbatim”  in  the 
HRS  setting. 
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In  particular.  Propositions  2. 7. 1  and  2. 7. 2  provide  results  which  were 
already  stated  1^  Porter  [  42  J  and  Saeks  [  48  j  for  the  case  of  lineai- 
operators. 

Proposition  2.  If  T  is  weakly  additive  the  following  statements  are 
equivalent: 

a)  T  is  causal 

b)  P^x  -  0  implies  P^'Tx  =  0 

c)  TP^  =  PtTP^ 

d)  P*T  =  pVp* 

e)  T  =  5^dPTP®. 

Proposition  3.  If  T  is  weakly  additive  the  following  statements  are 
equivalent: 

a)  T  is  memoryless 

b)  P^x  =  0  implies  P^Tx  =  0  and  P^x  =  0  implies  P^Tx  =  0 

c)  TP^  =  P*TP^  and  TP^  =  P^TP^ 

d)  pV  =  P*TP*  and  P^T  =  P^TP^ 

e)  T=  /dPTdr. 

In  regard  to  Propositions  2. 7. 3  and  2.  7. 4  it  is  of  interest  to  see 
the  modifications  needed  in  order  to  make  those  results  applicable  in 
a  HRS  context.  This  leads  to  the  following  Propositions  4  and  5. 

Proposition  4.  In  the  context  of  weakly  additive  systems  the  concepts 
of  strong  and  strictly  causality  are  equivalent. 
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Proof.  As  in  Proposition  2. 7. 3  it  is  sufficient  to  show  that  if  a  system 
is  weakly  additive  and  strongly  causal  then  it  is  also  strictly  causal. 
Suj^se  then  that  T  is  weakly  additive  and  strongly  causal.  By  the 
definition  of  strong  causality  and  Proposition  4.4. 1  we  obtain 

T  =  jfidPTP®  and  /dPTdP  =  0.  (4.  .3) 

Moreover  if  12  =  {t^  =  .  •  • ,  is  any  partition  of  u  then 

from  the  weak  additivity  of  T  it  follows 

N  N  ^  .  N 

I  AP«  )TP  *=  J  AP({  )TP  I  AP(|  )TAP({J. 

i=l  i=l  i=l 

This  implies  that 

5^dPTP®=  ^dPTP®  +  /dPTdP 
and  from  Equation  (4. 19)  it  follows  that 

T  =  i/idPTP®. 

We  can  then  conclude  that  T  is  strictly  causal. 

Proposition  5.  If  T  is  weakly  additive  and  crosscausal,  then  T  is  null. 

Proof.  Suppose  that  T  is  crosscausal.  Then 

/dPTdP  =  0,  5(idPTP®  =  0  and  i/idPTP  =  0. 

s 

Given  any  e  >  0  there  exists  a  partition  12^  of  v  such  that  for  any  other 
partition  12  of  i/,  ^  =  {t^  =  I  ,  I jyj  =  t^} ,  12  p  12^ ,  the  following 


relations  hold 
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N 

I  I  AP(|j)TAFap  I 
i=l 

I  f  AP(«i)TP^‘i 

<f- 


By  the  weak  additivity  of  T  we  have 


N  N  N  ^  N 

T  =  2  AP(«j)T=-2  AP(|,)TAP({,)  +  y  APTP  *+  V  AP{£,)TP, 
i=l  «  1=1  1=1  -  '1- 


It  follows  that  |TJ  <-^  from  the  arbitrarity  of  e,  T 

must  be  the  null  operator. 


The  next  three  propositions  illustrate  some  additional  properties 
of  weakly  additive  operators  on  a  HRS.  These  properties  will  turn  out 
to  be  useful  in  the  course  of  the  next  chapter.  In  regard  to  the  proofs, 
the  reader  no  doubt  recognizes  that  Proposition  6  is  a  direct  consequence 
of  Proposition  4  and  Theorem  5. 1.  Similarly,  Proposition  7  follows  from 
Proposition  4,  and  the  proof  of  Proposition  8  is  based  on  I  roposition  5 
and  Lemma  B.  3  in  the  Appendix. 

Proposition  6.  The  space  of  bounded  weakly  additive  and  strictly  causal 
systems  is  a  Banach  Algebra. 

Proposition  7.  A  necessary  and  sufficient  condition  for  a  causal  and 


weakly  additive  system  to  be  strictly  causal  is  that  / dPTdP  =  0. 
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Proposition  8.  If  T  is  a  linear,  causal  and  compact  operator  on 
[H,P*]  and{P*}  is  a  contimons  resolution  of  the  identity  then  T  is 
strictty  causal. 

In  r^ard  to  the  question  of  canonical  causality  decomposition, 
unfortunately  a  result  equivalent  to  Theorem  2. 7. 1  cannot  be  stated. 

In  fact  the  causality  canonical  decomposition  of  an  arbitrary  weakly 
additive  operator  may  not  exist.  Results  in  this  direction  are  limited 
to  the  following. 

Theorem  1.  If  T  is  weakly  additive  and  has  a  canonical  decomposition 
then  T  has  the  unique  representation  T  =  +  T^  +  Tj^,  where 

T^  =  ^dPTP®,  T^  =  l^dPTPg  and  Tj^  =  /dPTdP.  (4. 20) 

Proof.  In  view  of  Propositions  2, 3, 4  and  5,  we  have  to  show  that  if  a 

canonical  decomposition  exists,  then  T  and  T .  can  be  computed  through 

C  A 

Equations  (4,  20)  .  To  this  purpose,  observe  that  from  Theorem  6. 1 
the  following  relation  holds 

Tp  =  I^dPTP®  -  Tj, 

and  from  the  weak  additivity  of  T 

5|!dPTP®=  i^dPTP®+  /dPTdP. 

It  follows  that 


Tj,=  ^dPTP®  +  -  Tj,  .  ^dPTP® 
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and  from  the  causality  principle  of  duality 

T^=  iMtP,. 

The  proof  is  complete. 


The  statement  of  the  above  theorem  is  valid  also  for  linear  opera¬ 
tors  and  shows  that  even  in  this  context  the  canonical,  decomposition 
question  is  not  as  simple  as  it  was  thought  in  a  previous  study  ([  48  ]) . 
To  shed  some  hirther  light,  two  additional  propositions  are  introduced. 


Proposition  7.  Suppose  that  T  is  a  bounded  weakly  additive  operator 
and  that  Tj^  =  /dPTdP  is  well  defined.  Then,  given  any  c  >  0,  there 
exists  an  operator  T  such  that  |t  -  T  |  <  e  and  T  has  a  causality  canoni¬ 
cal  decomposition. 


Proof.  Choose  a  partition  =  {to  =  ‘ 

N 

I  2;  AP({j)TAP({.)  -  T  I  <e.  (4.21) 

i=l 


Consider  the  operator  T  defined  by  the  following  expression 
N  .  N 

¥=2  AP({j)TP  ‘‘  +Tj,+  I  AP(?j)TP  .  (4.22) 

i=l  i=l  ^i 


From  the  above  equation  T  has  a  canonical  decomposition.  Moreover 

N  N  ^ 

|t-t|=  I  Y,  AP(4)T-(2,  AP(5  )TP  ‘  +t 

i=  1  i=  1 

N 

+  V  aP({^)TP  ) 

i=l  ^i 


(4.23) 
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From  he  re  ami  Equations  (4. 24)  and  (4. 22)  it  follows 

N 

(T  -  t|  =  i  2;  AP(yTAP({i)  -  Twi  <e 
and  the  proof  thus  complete. 

Proposition  10.  Suppose  that  a  HRS  has  a  continuous  resolution  of  the 
identity.  Then  g^/en  aiqr  operator  T  and  any  real  e  >  0,  there  exists 
an  operator  T  suet,  that  )t  -  T  |  <  e  and  T  does  hr.ve  a  causality 
canonical  decompottltion. 

To  conclude  tl.ls  section  it  is  of  interest  to  observe  that  when  an 
operator  T  on  a  HRS  linear  then  all  of  the  above  results  are  auto¬ 
matically  valid.  In  those  cases  in  which  T  has  also  some  additional 
specific  anal3rtic  properties  various  other  interesting  causality  results 
can  be  stated.  This  is  done  partly  in  the  next  section  where  Hilbert 
Schmidt  operators  are  considered  and  partly  in  Appendix  C  where 
compact  and  (or)  self-adjoint  operators  are  considered. 

4. 8  Causality  and  Hilbert  Schmidt  Operators 

In  this  section  some  causality  properties  related  to  Hilbert 
Schmidt  operators  on  a  HRS  are  presented.  This  is  done  for  two 
main  reasons:  the  importance  of  this  type  of  operators  in  control 
and  communication  theory  ([  3 5  ] ,  [  46  ] ,  [  47  j ) ,  the  fact  that  the 
causality  properties  of  these  operators  enjoy  a  completeness  which 
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is  not  present  in  the  general  case  (for  example  the  canonical  decompo¬ 
sition  theorem  as  stated  in  [48  ]  is  true  for  Hilbert  Schmidt  operators) . 

Sui^ose  that  T  is  a  bounded  linear  operator  on  [h,  P*]  and  let 
{x^,  /3  £  E,  be  a  complete  orthonormal  set  in  H. 

Definition  1.  A  bounded  linear  operator  T  is  a  Hilbert  Schmidt  (in 
short  HS)  operator  if  the  quantity  j|T|| 

l|Tl|  =  {Z  |Tx|‘}^ 

(3cE 

is  finite.  The  number  |  |T  l|is  called  the  Hilbert  Schmidt  norm  of  T. 

The  following  two  lemmas  state  the  two  special  properties  of 
HS  operators  which  determine  their  particular  structure  with  respect 
to  causality. 

Lemma  1.  ([  16]  p.  ICIO) .  The  Hilbert  Schmidt  norm  is  independent 
of  the  orthonormal  basis  used  in  its  definition.  The  set  of  all  HS 
operators  is  a  Banach  space  under  the  Hilbert  Schmidt  norm. 

Lemma.  2.  The  Banach  space  of  HS  operators  is  a  Hilbert  space.  The 
inner  product  between  two  elements  T,  S  e  HS  can  be  defined  by 

<35.T>..y;  css  Tx  >. 

I3€E  ^  ^ 

The  causality  structure  of  HS  operators  can  now  be  clarified  by 


the  following  propositions. 


Proposition  1.  The  class  of  causal  (anticausal,  memoryless)  HS 


operators  is  a  Hilbert  space. 

Proof.  Let  CHS  (AHS,  MHS)  denote  the  space  of  causal  (anticausal, 
memoryless)  HS  operators.  Clearly  from  Lemma  2,  CHS  is  a  linear 
inner  product  space.  To  show  that  CHS  is  a  Hilbert  space  it  has  to 
be  proved  that  CHS  is  complete  under  the  norm  induced  by  the  inner 
product.  Suppose  then  that  {Tj}  is  a  Cauchy  sequence  in  CHS.  Since 
HS  is  complete,  the  sequence  {T  J  converges  to  an  operator  T  e  HS 
and  it  remains  to  be  shown  that  T  is  causal.  This  follows  from 
Proposition  5. 1  and  the  well  known  fact  that  the  operator  norm  is 
smaller  than  the  Hilbert  Schmidt  norm.  Applying  the  principle  of 
causal  duality,  it  follows  that  AHS  is  a  Hilbert  space.  From  the 
fact  that  MHS  =  CHS  n  AHS  it  is  obtained  that  MHS  is  also  a  Hilbert 
space.  The  proof  is  thus  complete. 

Proposition  2.  The  space  of  HS  operators  is  given  by  the  direct  sum 
of  the  three  orthogonal  subspaces  of  strictly  causal,  strictly  anticausal 
and  memoryless  operators. 

Proof.  Using  he  notation  adopted  in  the  proof  of  Theorem  1,  let 
CHS  =  CHS  n  (MHS)'^and  AHS  =  AKS  n  (MHS)'^where  (MHS)-*-  indicates 
the  complement  of  MHfj  in  HS.  Note  that  CHS,  AHS  and  MHS  are 
orthogonal  subspaces. 


Let  Ufc  now  prove  that  every  T  €  HS  has  a  canonical  decomposition 


In  view  of  Theorem  6. 1  this  means  that  it  has  to  be  shown  that  the 
integrals  ^dPTP®,  J^dPTP^,  /dPTdP  are  well  defined.  From  Lemma 
B.  3  in  the  Appendix,  it  is  obtained  that  Tj^  =  / dPTdP  is  well  defined. 
By  simple  inspection  the  following  relation  holds 


^dPTP®  /dP[T  -  T„]P®, 


where  rdP[T  -  Tj^jdP  =  0.  From  Lemma  B.  6  and  Lemma  B.  4  it 
follows  that  ^dPTP^  is  well  defined.  By  the  principlt,  of  duality 
IjfidPTP.  is  also  well  defined.  If  we  now  observe  that  1'  e  CHS, 

€  .^HS  and  e  MHS,  then  we  obtain  that  T^,  and  Tj^  are 
mutually  orthogonal. 

To  complete  the  proof  it  remains  to  be  shown  that  the  spaces 
CHS  and  AHS  are  made  respectively  of  strictly  causal  and  strictly 
anticausal  operators.  To  this  purpose  suppose  that  T  c  CHS.  If  T 
is  not  strictly  causal  then  we  can  write  T  =  T^  +  Tj^,  where  T^e  CHS 
and  Tj^  0  e  MHS.  This  is  a  contradiction  to  the  fact  that  CHS  is 
orthogonal  to  MHS.  We  can  then  conclude  that  CHS  consists  of  strictly 
causal  operators  and,  from  the  principle  of  causal  duality,  that  AHS 
consists  of  strictly  anticausal  operators.:  The  proof  of  the  proposition 
is  thus  complete. 
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► 

Proposition  3.  Suppose  that  T  is  a  HS  operator.  Then  there  exists 
a  unique  HS  operator  j  e  {A,  C,  M,  A,  c}  such  that 

||T-Tj|  =  miii  ||t-tJ| 

« 

where  is  any  a  HS  operator  and  is  the  a  component  of  T. 

The  proof  of  Proposition  3  is  a  direct  consequence  of  Proposition 
2  and  is  omitted  for  brevity.  From  the  combination  of  thi  statements 
of  Propositions  1  and  2  we  have  the  following  theorem. 

Theorem  1.  Every  Hilbert  Schmidt  operator  has  a  causality  canonical 
decomposition.  The  components  of  this  decomposition  are  mutually 
orthc^onal. 

4.9  Summary 

The  contents  of  this  chapter  can  be  summarized  from  two  pclr.es 
of  view:  refinements  of  the  GRS  results  in  Chapter  2  or  generalization 
of  the  causality  study  developed  by  Porter  [43]  and  Sacks  [48]. 

From  the  first  point  ol  view,  the  present  development  snows  how 
concepts  and  techniques  in  GRS  can  be  applied  to  systems  defined  on  a 
HRS.  In  the  transition,  the  validity  of  most  of  the  results  can  be  main¬ 
tained.  This  is  illustrated  by  a  number  of  propositions. 

The  ’’sum"  type  representations  which  were  so  helpful  in  GRS 
become  "integrals"  in  HRS.  This  allows  an  efficient  utilization  of  the 
results  on  integral  transformators  due  to  mathematicians  of  the  Russian 
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school  ([24],  [25]) .  Results  from  this  latter  study  were  used  to  show 
that  the  existence  of  a  canonical  causality  decomposition  does  not  carry 
over  in  HRS.  This  is  illustrated  by  Theorem  6. 1  for  the  case  of  general 
operators  and  by  Theorem  7. 1  for  ti.'  case  of  weakly  additive  and  linear, 
operators.  The  situation  is  somewhat  different  for  linear  operators 
with  a  special  Analytic  structure.  In  particular  every  Hilbert  Schmidt 
operator  has  a  canonical  causality  decomposition.  Moreover,  the 
components  of  this  decomposition  can  be  viewed  as  mutually  orthogonal 
(Theorem  8. 1) . 

In  regard  to  the  second  point  of  view,  it  should  be  emphasized 

I 

that  in  the  case  of  linear  operators  the  present  development  coincides 
’Verbatim”  with  that  in  [48],  The  bridge  hetwesn  the  cwo  approaches 

I 

is  provided  here  by  Propositions  5. 1-2.  It  is  important  to  observp 
hov/ever  that  the  main  result  in  [48]  (that  is  Theorem  2. 3.  5)  is  in 
contradiction  with  our  Theorem  7. 1.  '  This  is  because  the  properties 
of  integral  transformators  are  not  as  extensive  as  it  was  assumed  in 

f 

that  study.  ' 


5.  CAUSALITY,  STRICT  CAUSAUTY  AND  STABILITY 


5. 1  Introduction* 

To  Kotivate  the  development  of  the  present  chapter,  let  us  start 
to  consider  the  following  linear  integral  VoUerra  equation 

s 

y(s)  =x(s)  -  /  K^s,t)x(t)dt,  s€[0,oo)  (5.1) 

o 

where  y(. )  is  a  known  element  of  the  Hilbert  space  L,[  0,  oo)  while 
K(s,  t)  is  a  known  kernel  of  the  equation  and  x{. )  :s  an  unknown  func¬ 
tion  to  be  computed. 

As  it  is  well  knownt,  if  the  following  condition  is  satisfied 

_0O  QC  „ 

k  «  . . 

(5.2) 


I  I  K^(s,  t)  dsdt  < 


00 


o  0 


then  Equation  (5. 1)  has  a  unique  solution  for  every  y  e  L„[0,  oo) . 

a 

Moreover  this  solution  can  be  computed  by  the  formula 


a 

x(s)  =y(s)  +  /  K(s,t)y(t)dt,  te  [0,oo) 


(5.  3) 


Here  K(s,t)  is  callec  the  re.-olving  kernel  of  the  Volterra  equation 
and  it  can  be  computed  by  the  following  expression 


00 


K(s,t)  =  2  K"(s,t) 
n=l 


(5.4) 


where  k'(s.  t)  =  K(s.  t)  and  k"(s,  t)  =  K(s.  • ) .  k"'  \ ,  t) ,  n=2. 3, . . .  , 


Most  of  the  mathematical  concepts  used  in  this  chapter  are 
defined  in  Section  4.2. 

t  See,  for  example,  reference  f  34  J . 
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In  relation  to  Equation  (5. 1) ,  Gohberg  and  Krein  f  25j  observed 
that  the  kernel  K(s,  t) ,  viewed  as  an  operator  K  on  the  Hilbert  space 
0,  Qo) ,  has  the  following  properties: 

a)  K  is  linear 

b)  K  is  compact 

c)  K=  ^dPKP®. 

The  integral  of  c)  has  to  be  interpreted  in  the  uniform  convergence 
sense  defined  in  Section  4. 1  and  is  computed  with  respect  to  the 
family  { P^}  of  truncation  operators  on  L2[  0,  oo) . 

The  above  observation  of  Gohberg  and  Krein  led  to  the  study  of 
a  ’’generalized  linear  Volterra  equation’*  of  the  type 

y  =  X  -  Kx  (5.  5) 

where  y  is  an  assigned  element  of  a  given  Hilbert  space  H,  K  is  a  known 
operator  on  H  and  enjoys  properties  a) ,  b) ,  c)  and  x  is  an  unknown  ele¬ 
ment  to  be  computed.  The  result  of  this  study  was  the  following:  under 
hypotheses  a) ,  b) ,  c)  the  solution  to  Equation  (5.  5)  exists,  is  unique 
and  can  be  computed  by  the  formula 

x  =  y  +  Ky  (5.6) 

where  the  operator  K  is  given  by  the  following  expression 

K=-e  2  K 

n=l 


(5.7) 
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where  =  K  and,  for  n=2, 3, . . . ,  K*'  is  given  by  the  composition  of 
KwithK""^ 

The  above  results  can  be  given  a  meaningful  engineeriig  inter- 
pretation.  To  this  purpose  a  brief  review  of  current  technical  termi- 
nol(^  is  in  order.  To  Equation  (5.  5)  we  can  associate  a  closed  loop 
basic  feedback  system  of  the  type  in  Figure  5. 1.  The  operator  K 
is  called  the  open  loop  system  and  the  problem  of  investigating  some 
of  the  characteristics  of  the  solution  x  in  Equation  (5.  5)  is  generally 
called  the  feedback  system  stability  problem. 

The  stability  problem  for  systems  of  this  type,  or  equivalent 
types,  has  been  studied  by  a  number  of  authors  (see  for  example 
[ll],  [40  ],  [52],  [59],  [67],  [68]).  In  particular  (Damborg 
[  11  ])  the  basic  feedback  system  is  called  stable  if  the  operator 
(I-K)  is  invertible,  and  its  inverse  is  bounded  causal  and  continuous*. 

Using  the  terminology  introduced  above,  the  result  offered 
by  Grohberg  and  Krein  can  be  rephx-ased  as  follows:  ”A  sufficient 
condition  for  a  basic  feedback  system  to  be  stable  is  that  the  open  loop 
system  be  linear  compact  and  strictly  causal". 

This  result  is  very  attractive  in  its  technical  conciseness. 

Ho  ever  in  stability  theory  the  operator  K  is  in  general  not  compact. 
The  following  natural  questions  then  arise: 

Ql:  Can  the  above  result  be  extended  to  the  case  in  which  K  is  linear 
bounded  and  strictly  causal  but  not  necessarily  compact? 

*An  operator  T  on  a  Banach  space  B  is  continuous  if  for  any  xe  B 
and  e  >  0,  there  exists  a  6  >  0  such  that  |Tx  -  Ty  |  <  c  when  |x  -  y  |  <  6. 
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Q2:  If  this  extension  is  feasible  can  it  be  carried  further  so  as,  for 
example,  to  apply  to  some  special  class  of  nonlinear  systems? 

The  following  sections  are  devoted  to  the  task  of  answering 
these  type  of  questions.  A  brief  comment  on  their  contents  may  be 
helpful.  The  central  results  of  the  chapter  are  stated  in  Section  2 
and  are  related  to  a  special  class  of  weakly  additive  systems.  In 
Section  3  these  results  are  specialized  to  the  case  of  linear  systems. 
Further  results  are  introduced  in  Section  4.  Finally  Sections  5  and 
6  discuss  respectively  some  applications  and  concluding  remarks. 


Figure  5. 1  :  Basic  Feedback  System 
5.  2  Stability  and  Causality 

In  this  section  we  consider  the  questions  Q1  and  Q2  which  were 
posed  in  the  introduction.  As  it  turns  out,  it  is  possible  to  give  a 
completely  affirmative  answer  to  Ql.  The  proof  of  this  result  depends 
very  little  on  the  linearity  of  K.  This  fact  is  rather  remarkable  if  it 
is  considered  that  the  proof  offered  by  Gohberg  and  Krein  for  their 
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result  was  based  in  an  essential  way  on  the  spectral  theory  of  bounded 
linear  operators  (see  Theorem  6. 1,  p.  27  in  [25]) . 

According  to  the  proof  proposed  in  this  section,  what  seems  to 
be  essential  is  the  property  of  weak  additivity  which  was  already  con¬ 
sidered  in  Sections  2. 7  and  4. 7.  In  view  of  this  fact  it  is  convenient 
to  reverse  the  order  of  consideration  of  Q1  and  Q2.  Thus  while  the 
following  results  can  be  considered  as  related  to  Q2,  a  formal  answer 
to  Q1  is  obtained  as  a  corollary. 

To  start  consider  the  following  technical  result. 

Proposition  1.  Suppose  that  K  is  a  causal  Lipschitz  continuous*  opera¬ 
tor  with  Lipschitz  norm  less  than  1.  Then  the  basic  feedback  system 
is  stable. 

Proof  i)  (I-K  is  invertible.  We  have  to  show  that  for  every  y  e  H 
the  equation 

y  =  X  -  Kx  (5.8) 

has  a  unique  solution.  This  is  clearly  equivalent  to  establishing  exis¬ 
tence  and  uniqueness  of  a  fixed  point  x  for  the  operator  T^  :  H  H 
defined  by 

Ty(x)  =  y  4  Kx. 


*An  operator  T  on  a  Banach  space  B  is  called  Lipschitz  continuous 
if  there  exists  a  positive  real  number  L  such  that  sup  [Tx  -  Ty  (  /  [x  -  y 
<  L.  Lis  called  the  Lipschitz  norm  of  1 e  B 
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Note  that  the  operator  is  such  that  for  any  pair  x^,  X2  e  H  the 
followii^  relation  holds 

|Ty(Xi)  •=  Ty(X2)  I  =  iKXj  -  KX2I  <  L  |xj  -  Xgl 

where  L  <  1  is  the  Lipschitz  norm  of  K.  We  can  then  apply  the  Banach 
contraction  mapping  theorem  (see  for  example  [11],  Lemma  4. 1,  p.  84) . 
This  theorem  states  that  the  desired  fixed  point  x  exists  and  it  is  unique. 

ii)  (I-K)  is  bou.ided  and  continuous*.  It  will  clearly  be  siifficient 
to  show  that  (I-K)  is  Lipschitz  continuous.  To  this  purpose  observe 
that  for  any  pair  x^.Xg  e  H,  we  have 

|xj^  -  KXj  (Xg  -  KX2)  I  =  |xj  -  X2  +  KX2  -  KXj  I 

>  |xj  -  X2 1  -  jKXg  ~  KXj  I  >  (1  -  L)  |xj  -  Xg  i  (5.9) 

where,  once  again,  L  <  1  is  the  Lipschitz  norm  of  K.  Set 

yi  =  (I-K)Xj 

y2=(I-K)x2  (5.10) 

From  Equations  (5.9)  and  (5. 10)  and  the  fact  that  (I-K)  is  invertible, 
it  follows  that  for  each  ypy2  c  H,  we  have 

|y,-  1^\  >(1-L>  |(I-K)'V,  -  (I-Kj'Vjl-  (5.11) 

This  implies 

*This  result  has  been  noted  also  by  Zarpntonello  |70]. 
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|(i-K)'*yi  -  a-wVol 

- i - —  <  1/(1-L) .  (5. 12) 

br  »2l 

We  can  then  conclude  that  (I-K)  '^  is  Lipschitz  continuous, 
iii)  (I-K)”^  is  causal.  Suppose  that  yj,y2»*i»*2  ^  ® 

Xj  =  (I-K)  ‘ Vj,  *2  =  (I-K)  ■  ^2-  (5. 13) 

To  prove  that  (I-K)  is  causal,  it  is  sufficient  to  show  that  if  pVj  = 
pV2»  then  P^x^  =  P^Xg. 

Note  that  from  Equation  (5. 13)  and  the  hypothesis  that  K  is  causal, 
we  can  write 


pVj  =  P*x^  -  P^KP*Xj 
PV2  -  -  pWxg. 


For  P^yj  =  PV2  it  follows  that 


|P*x 


.t 


.t,_t 


1 


Px„  =  P  KP  x„  -  P'-KP  x 


I'* 


(5. 14) 


From  this  equation  we  must  have  P^Xg  =  P^x^  because  if  P^X2  P^Xj^ 
then  we  would  obtain  a  contradiction  to  the  hypothesis  that  the  Lipschitz 
norm  of  K  is  less  than  1. 


The  above  proposition  allows  to  state  and  prove  the  central 


theorem  of  this  chapter. 
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Theorem  1.  Suppose  that  K  has  the  followii^  properties: 

a)  K  =  where  is  a  mcmoryless  Lipschitz 

continuous  operator  and  are  bounded  linear 

operators; 

b)  is  strictly  causal  and  is  causal; 

c)  the  norm  of  is  less  than  1. 

Then  the  basic  feedback  system  is  stable. 

Proof.  I-K  is  invertible.  V/e  have  to  show  that  for  any  element  y  e  H 
we  can  find  a  unique  element  x  €  H  such  that  the  following  equation  is 
satisfied 

y  =  X  -  Kx.  (5. 15) 

To  start,  Jet  L  be  the  Lipschitz  norm  of  N.  and  suppose  that  |k~  |  =1-6, 
where  0  <  5  <  1.  Then  lor  every  pair  XpXg  e  H  we  have 


Vr  V2I 

<  L|xj  -  Xgl 

(5.1R) 

Kc*!  - 

1  <(1  -  6)  |xj  -  Xgl- 

(5.17) 

Note  that  from  the  strict  causality  of  K  we  can  find  a  partition  of 
the  ordered  set  i/,  =  {t^  =  ^2’ '  *  ’  ’ 

N 

I  Z  AP(^ .)  i  <  6/2L. 

i=l  - 


This  implies  that 
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|AP(^.)K^  AP(|p  I  <  6/2L  (5. 18) 

for  every  i=l,  2, . . . ,  N.  From  Equations  (5. 16) ,  (5. 18)  and  the  fact 
that  is  memoryless,  it  follows  that  for  each  i=l,  2, . . . ,  N  and  any 
pair  XjjXg  e  H,  we  have 

|aP({,)Kj,N^AP({j)Xj-  AP(«j)Kj,N^AP($,)X2|  = 

=  |M>(?,)  Kj,AP(?j)  -  AP(4 j)  Kp  N^(4j)X2  | 

<4:  -  NjAP(5j)x2|  <  Y  |AP(«i)xj  -  AP(5j)x2|. 

This  equation  together  with  Equation  {5. 17)  implies  that  for  each 
i=l,  2, ....  N  and  any  pair  e  H  we  have 

tAP({j)KAP(|,)x.  -  APaj)KAP(«i)x,| 

- ! - !-i - <  1.  (5. 19) 

liPapxj-^UpXjl 

Observe  now  that  to  solve  Equation  (5. 15)  is  equivalent  to  finding 
an  X  €  H  such  that  the  following  equation  is  satisfied 

AP(^i)y  =  AP(4px  -  APi^^KP  'x  (5.20) 

where  i=l,  2, . . . ,  N.  Indeed,  if  x  e  H  satisfies  Equation  (5. 15)  then, 
from  the  causality  of  K,  AP(^,px  must  clearly  satisfy  Equation  (5.  20)  - 
Conversely,  suppose  that  the  element  x  €  H  is  such  that  AP(^^)x  does 
satisfy  Equation  (6.  20) .  Then  we  have 


136 


N  N  N  ^ 

I  AP(Uy=  2]  2  AP(f.)KP  'x. 

i=l  i=l 

To  see  that  this  last  equation  coincides  with  Equation  (5. 15) ,  it  suffices 

to  note  that  from  the  causality  of  K  we  can  write 

N  ^  N 

y  APUOKP  =  y  AP(L)Kx  =  Kx. 

i=^l  "  i=l 

For  i=l,  Equation  (5,20)  becomes 

AP(^j)y  =  AP(f  j)x  -  AP(t  j)KaP(^^)x.  (5.  21) 

By  Equation  (5. 19) ,  AP(|^)KAP(|  j^) ,  the  restriction  of  K  to  the  Hilbert 
space  AP(^j)H,  is  Lipschitz  continuous  with  Lipschitz  norm  less  than 
1.  Proposition  1  can  then  be  applied  and  there  exists  a  bounded  con¬ 
tinuous  causal  operator  Tj  such  that  the  element 

AP(fpx  =  Tj  AP(^j)y  (5.22) 

(and  only  this  element)  satisfies  Equation  (5.  21) . 

For  i=2,  Equation  (5.20)  becomes 

From  the  fact  that  K  is  weakly  additive  (see  Proposition  4. 7. 1)  we  can 
rewrite  this  equation  as  follows 
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AP(r2)y  +  Ai’(?2)KAP(^j)x  =  -  ^U2^ICAP(^2)x. 

Again  by  Equation  (5. 19) ,  AP(|2)KAP(|2)  >  the  restriction  of  K  to  the 
Hilbert  space  AP(^2)  ts  Lipschitz  continuous  with  Lipschitz  norm 
less  than  1.  Proposition  1  can  again  be  applied  and  there  exists  a 
bounded  continuous  and  causal  operator  Tg  such  that  it  provides  the 
following  unique  solution  to  Equation  (5.  23) 


-  AlH^g^x  =  T2  AP(^2Hy  +  KAP(?  j}x] 


where  AP(|j^)x  is  defined  by  Equation  (5.  22) .  By  induction,  having 
computed  AP(|  j^)x,  aP(^2)x>  •  •  •  >  the  solution  to  Equation 

(5.  20) .  AP(^i)x,  can  be  computed  as  follows 


i-1 


APU.)x  =  TiAPUi)[y +  K  I  AP(C.)x] 

j=l  ^ 


(5.  24) 


where  T-  is  a  bounded  continuous  and  causal  operator. 

N 

The  above  recursive  relations  define  the  element  x  =  AP(^.)x 

i=l 

and  this  element  is  the  unique  solution  to  Equation  (5, 15) .  We  can 
then  conclude  that  I-K  is  indeed  invertible. 

ii)  (1-K)  ^  is  bounded.  Suppose  that  x  =  (I-K)  Note  that  for 
each  i=l,  2,  3,  N,  AP(|p  (I-K)  ^  is  defined  by  Equation  (5.  24) . 
Using  the  boundedness  of  K,  and  applying  Proposition  1,  it  is  easy 
to  verify  that  there  exists  a  set  of  real  positive  numbers  Mg, 

M;i,  . . . ,  M!,  M!'  such  that 

6  IX 

|<a>(?j)(I-K)'V|  <Mj|y| 


X.UU 


and  for  i=2,  3, 4, . . . ,  N 


|APaj)(i-K)'V|  <m;  iy|  -  m:'  |p'‘' xj. 


i-1  ! 


From  this  equation  it  follows  that  there  exists  a  positive  M  such  that 

[(I-K)'Vi  <M|y|. 

It  can  then  be  concluded  that  (I-K)  ^  is  bounded. 

iii)  (I-K)  ~^  is  continuous.  Observe  that  the  continuity  of  (I-K)  ~^ 
is  equivalent  to  the  continuity  of  AP(^j)  (I-K)  ~  \  j=  1,  2, . . . ,  N,  where 
is,  once  again,  the  partition  of  v  considered  in  part  i) .  The 
transformation  AP(^.)  (I-K)  is  defined  by  Equation  (5.  24)  where 

fc_l 

P^  X  is  a  function  of  y.  By  Proposition  1,  this  transformation  is 

^1-1  -1 
continuous  with  respect  to  y  and  P  x.  It  follows  that  AP(^.)  (I-K) 

is  continuous  on  y.  But  from  Equation  (5.  22)  and  Proposition  1,  the 


element  P  x  depends  continuously  on  y.  Then  also  P  x  depends  con- 

Vi 

tinuously  on  y  and,  by  induction,  P  x  depends  continuously  on  y  for 
each  j=l,  2, ....  N.  We  can  then  co:  elude  that  (I-K)  is  continuous. 

iv)  (I-K) '  ^  is  causal.  By  virtue  of  Proposition  4. 4. 1  it  suffices 
to  prove  that  for  any  t  e  u  and  any  y  f  H,  the  following  relation  holds 


pVk)"V=  pV-k)‘^pV- 

Consider  the  partition  of  n  given  by 


(5.  25) 


■  "Lto-  ^0’  42»  •  •  • »  . "  ^00^ 
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where  •  •  •  >  Ijj}  is  the  partition  J2  considered  in  part  i)  of  this 

proof  and  it  has  been  assumed,  without  any  loss  of  generality,  that 

t  €  ^ Use  the  following  notations 

1  1  2  ,^,-1  2 
X  =  (I-K)  y  ,x  =  (I-K)  y 

1  2  t 

where  y  =  y  and  y  =  P  y.  From  Equation  (5.  24)  the  following  relation 
holds 

n  1  N  ^ 

x'*=  (I-K)“  V  =  Z  T  lAP(^  )|y^+  KP 

+  TJ(P^-  P^'‘^[y^T  KP^^'M]] 

+  T.[(P  pS[y^+  KP  ^x^]] 


where  q=l,  2.  By  inspection,  from  this  equation  we  have 

Jl  1  Jl  2 

P  X  =  P  X 

^91  ^22 

P  ^X^  =  P  ^X^ 

r?i  1  r.^'i  2 

P  X  =  P  X 

r,t  1  Tjt  2 

P  X  =  P  X 

This  implies  the  validity  of  Equation  (5.  25) .  The  proof  of  the  theorem 
is  at  this  point  complete. 


5. 3  Stability  and  Causality  for  Linear  Systems 

All  of  the  resu-.s  in  Section  2  are  valid  in  particular  when  the 
open  loop  system  under  consideration  is  linear.  In  this  case  however 
those  results  can  be  further  improved.  The  follov/ing  theorem  not 
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only  guarantees  the  stability  of  the  basic  feedback  system  but  it  also 

gives  an  expression  for  the  computation  of  the  feedback  operator 

- 1  '  ■ 

(I-K)  .  Before  stating  this  theorem  it  is  convenient  to  revisit 

Proposition  2. 1. 

Proposition  1.  If  K  is  linear  bounded  and  causal  and  it  has  norm  less 

than  1,  then  the  basic  feedback  system  is  stable.  Moreover,’  (I-K)  ~^ 

can  be  computed  by  the  following  Neumann  series 

1  00 

(I-K)"  =I+y  K  .  (5.26) 

>  n=l 

Proof.  Observe  that  from  the  fact  that  jKj  <  l.we  have  tliac 

lim  ’  I  2  <  lim  Z  1^^= 

N->qo  n=N  N-»qo  n=N 

i 

and  therefore  the  right  hand  side  of  Equation  (5.  26)  represents  a  well 
defined  operator.  In  view  of  Proposition  2. 1,  it  remains  then  to  be 

*  I 

proved  that  Equation  (5.  26)  is  true.  This  is  equivalent  to  show  that 
for  any  element  y  e  H'the  element  x,  , 

x=  (1+  Z 

n=l 

satisfies  the  equation 


y  =  X  -  Kx. 


This  is  easily  done  by  inspection 

y  =  y  +  J  K"y  -  K[y  +  ^  K^'y] 
n=l  ,  n=l 

00  n 

=  y  4  V  K  y  -  Ky  -  Z  ^  V  =  y- 
n=  L  n=  2 


I 
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Theorem  1,  Suppose  that  K  has  the  following  properties: 

a)  K  =  +  K^,  where  is  strictly  causal  and 

is  causal 

b)  and  K  are  linear  and  bounded 
C  c 

c)  the  norm  of  is  less  than  1. 

Then  the  basic  feedback  system  is  stable.  Moreover  (I-K) '  ^  can  be 
computed  by  the  following  Neumann  series 

1  CO 

(I-K)"  =1+  y  K  .  (5.27) 

n=l 

Proof.  Clearly  K  satisfies  the  hypotheses  of  Theorem  2. 1  and 
therefore  the  stability  of  the  basic  feedback  system  follows  from 
that  theorem. 

It  remains  to  be  shown  that  Equation  (5.  27)  holds.  To  this 
purpose,  choose  a  partition  n  =  {t^  =  Iq»  •  •  •  >  of  ^  such 

that  for  all  i=  1,  2, . . . ,  N  we  have* 

|aP(5j)KAP(?j)  i  <  1  (5.28) 

and  consider  the  result  of  the  next  proposition.  Note  that  from  Pro¬ 
position  2. 1  and  Equation  (5.  28)  it  follows  that  Equation  (5.  29)  holds 
for  n=l.  Moreover,  by  virtue  of  Proposition  2,  Equation  (5.29)  holds 
also  for  n=2,  3, . . . ,  N.  The  proof  can  then  be  concluded  by  observing 
that  for  n=N,  Equation (5.  29)  coincides  with  Equation  (5.  27) . 

*Note  that  in  the  development  of  the  proof  of  Theorem  2. 1  it  was 
shown  that  this  choice  of  fi  is  always  possible. 
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Proposition  2.  Suppose  that  the  partition  $2  satisfies  Equation  (5. 28) 
and  that  the  hypothesis  of  Theorem  1  are  satisfied.  If  for  n=  1,  2, . . . ,  N, 
we  have 

P  "(I-P  ^P  )  ^P  ”=  P  +  ^  (P  “kP  (5.29) 

j=l 

then  we  have  also 

p^"+^(I_P^"+^KP^"+V^  +  F  (P  (5.30) 

3=1 

Proof.  Let  us  start  by  introducing  the  following  simplification  in 
notations 

^n  ^n+1 

P  =  P  ,  Q  =  P  ^  ,  A  =  Q  -  P 


and  assume  that  Equation  (5.  29)  holds.  We  have  to  prove  that  Equation 
(5. 30)  is  also  valid.  To  this  purpose  consider  any  element  y  in  H  and 
let  Qx  and  Px  be  defined  by  the  following  expressions 

Qx  =  Q(I-QKQ)"^Qy 

Px  =  P(I  -  PKP)"^Py. 


Note  that 


Qx  =  Px  +  Ax 


where,  applying  respectively  Proposition  2. 1  and  Equation  (5.  29)  we 


00 

Ax  =  Ay  +  AKPx  +  f AKAj^(y  +  AKPx) 

j=l 


have: 
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and 

00 

Px=Py+  2  (PKP)V 
j=l 

It  follows 

00 

Qx  =  Qy+  Z  (PKP)V 
i=i 

OO 

+  AK[Py+  I  (PKP)V]  +  E 
i=i  j=i 

+  f  [^A]^K[Py+  E  (PKP)Vl- 

j=i  i=i 

From  the  linearity  of  K  and  a  convenient  rearrangements  of  the 

terms  on  the  right  hand  side  of  this  equation  we  obtain 

00  .  . 

Qx  =  Qy  +  E  f(PKP)^  +  (AKA)^ 

j=l 

+  E  {AKA)%(PKP)'”]y  (5.32) 

q+m=j-l 

where  q,  m  €  {0, 1,  2, . . . }  and  the  following  notations  have  been  used 

(AKA)°  =  A  and  (PKP)°  =  P. 

Suppose  now  that  for  each  j=:l,  2, . . .  we  have 

(PKP)  ^  +  (AKA)  ^  +  E  %(PKP)  ^  =  (QKQ)  \  (5.  33) 

q+m=j-l 

This  equation  and  Equation  (5. 32)  would  imply 

QO 

Qx  =  Qy  -fc  E  (QKQ)  ^ 
j=l 
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and  with  an  obvious  change  of  notations  this  last  equation  coincides 
with  Equation  (5. 30) .  To  complete  the  proof  of  the  proposition  it 
remains  then  to  check  the  validity  of  Equation  (5. 33)  for  j=l,  2, 3, . . .  . 
To  this  purpose  verify  by  direct  inspection  that  Equation  (5. 33)  holds 
for  j  =  1,  that  is 

PKP  +  AKA  +  AKP  =  QKQ.  (5.  34) 

From  this  equation  and  an  induction  argument  it  is  easy  to  verify 
that 

(PKP)  ^  +  (AKA)  +  Yj  %(PKP)  ^ 

q+m=j 

=  [(PKP)^  +  (AKA)^  +  Y  (AKA)%(PKP)"^]QKQ  (5.35) 

q+m=j-l 

where  j=l,  2, . . .  .  This  equation  and  Equation  (5. 34)  imply  that 
Equation  (5. 33)  is  valid  for  j  =  2,  that  is 

(PKP)  ^  +  (AKA)  ^  +  Y  (^)  ^K(PKP)  ^  =  (QKQ) 

q+m-1 

From  this  and  Equation  (5. 35)  it  follows  that  Equation  (5.  33)  is  also 
valid  for  j  =  3.  Proceeding  by  induction  we  can  conclude  that  Equation 
(5.33)  is  valid  for  all  j=l,  2, 3, . . .  .  c;^ 

As  an  immediate  consequence  of  Theorem  1  we  have  the  follov/ing 
corollary.  This  corollary  provides  a  direct  answer  to  question  Q1  in 


the  introduction.  It  also  has  a  meaningful  physical  interpretation: 
under  certain  circumstances  the  stability  of  the  feedback  system  can 
be  secured  by  an  appropriate  reduction  of  the  gain  of  its  memoryless 
part. 

Corollary  1.  Suppose  that  K  has  the  following  properties: 

a)  K  =  +  Kj^  where  is  strictly  causal  and  Kj^ 

is  memory  less 

b)  and  are  linear  and  bounded 

c)  the  operator  norm  of  is  less  than  1. 

Then  the  basic  feedback  system  is  stable.  Moreover  (I-K)  can  be 
computed  by  the  following  Neumann  series 

(I-K)"^=I+  f  k". 

h=l 

Other  interesting  implications  of  Theorem  1  are  established  by 
the  following  two  propositions.  Proposition  3  can  often  be  applied  in 
practical  situations.  Proposition  4  states  some  conditions  for  the 
input-outpuc  equivalence  of  the  systems  in  Figure  5.  2. 

Proposition  3.  If  K  is  a  linear,  compact  and  causal  operator  on  a 
HRS  with  a  continuous  resolution  of  the  identity,  then  the  basic  feed¬ 
back  system  is  stable. 

Proof.  From  the  hypotheses  and  Lemma  B.  3  in  the  apoendix,  we 
obtain  that  JdPKdP  =  0.  From  Proposition  4.7.7  it  follows  that 
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k  is  strictly  causal.  At  this  point  the  desired  result  follows  from 
Theorem  1. 


Proposition  4.  If  T*  and  T"  are  linear  bounded  and  strictly  causal, 
and  T’l  *’  =  T"T'  =  0,  then 

(I-T’-T")'^  (T*+T")  =  (I-T*)'^T’  +  (I-T’')“  V’. 


Proof.  Applying  Theorem  1  we  obtain  the  following  equations: 

1  °° 

(I-T*-T”)  =1+  Yj  (T'+T") 

n=l 

(I-T')'‘=I+  X  (T’)" 
n=l 

(I-T")'  =1+  Y  (T”)" 
n=l 

Using  the  fact  that  T’T”  =  T"T’  -  0  we  have. 


(T'+T")"=  (T’)”  +  (T")"- 


Hence: 


"I  n 

(I-T’-T")'lT’+T”)  =  Y  (T'+T") 

n=l 

00  00 

=  J  (T')"+  2  (T”)” 

1^1  n=l 

=  (I-T’)‘^T'  +  d-T”)"  V’. 


The  proof  is  thus  complete. 
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5, 4  Some  further  results 

The  results  in  the  previous  two  sections  provide  a  clear  indication 
of  the  technical  convenience  which  derives  by  associatii^  the  mathe¬ 
matical  development  of  the  theory  of  non- self-adjoint  operators  of 
Gohbeig  and  Krein  ([  24  ] ,  [  25  ] ) ,  with  the  study  of  causality  in  Hilbert 
resolution  spaces  (Chapter  4  and  [  41],  [42  j,  f  48  j)  and  with  the  stability 
theory  framework  proposed  by  Damborg  ([  11  ]) .  This  convenience  is 
further  substantiated  by  the  fact  that  Damborg' s  development  can  be 
directly  rephrased  in  terms  of  Hilbert  resolution  spaces.  When  this 
is  done  a  substantial  gain  in  generality  is  obtained.  It  suffices  to  note 
that  most  of  Damborg's  results  become  immediately  and  simultaneously 
applicable  to  continuous  time,  sampled  data  and  hybrid  systems. 

It  is  to  be  expected  that  the  extent  of  the  results  arising  from 
the  above  three  independent  developments  is  not  limited  to  those 
already  discussed.  To  justify  at  least  in  part  this  expectation,  some 
further  results  are  introduced. 


The  next  theorem  applies  when  the  hypotheses  of  Theorems 
2. 1  and  3. 1  are  not  readily  verified.  In  this  case  it  is  often  possible 
that  the  invertibility  of  (I-K)  and  the  continuity  of  (I-K)  can  be 
established  through  subsidiary  physical  or  mathematical  arguments 
(see  for  instance  [  11  ],  [  12]) .  To  insure  the  stability  of  the  basic 
feedback  system  it  remains  then  to  verify  that  (I-K) '  ^  is  causal. 

The  following  theorem  states  that,  under  some  appropriate  hypotheses, 
a  sufficient  condition  for  this  verification  to  be  successful  is  that  the 
open  loop  system  is  "almost"  strictly  causal. 

Theorem  1.  Suppose  that  T  satisfies  the  following  conditions: 

a)  T  =  +  T^,  where  T^  and  T^  are  respectively  strictly 

causal  and  causal  operators 

b)  T^  is  bounded  and  T^  is  Lipschitz  continuous 

c)  is  weakly  additive  and  has  Lipschitz  norm  less  than  1 

d)  I-T  is  invertible  and  (I-T)  ^  is  Lipschitz  continuous. 

Then  (I-T)  ^  is  causal. 

Proof.  Since  T^  is  strictly  causal,  there  exists  a  sequence  of  opera¬ 
tors 

a  N  ^ 

I  TP  ^ 

i=i  ^ 

iL  0. 

such  that  (I  }  — >  T^.  Clearly  (l  +  T^}  T.  For  each  operator 
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I  \  and  any  element  y  e  [  H,  P']  the  equation 

$2. 

y  =  X  -  I  'x  -  T^x 

has  the  unique  solution  x  defined  by  the  following  recursive  relations 

AP({j)x  =  AP(4j)(I-T^,)'*^(5j)y 
AP(5-2)x  =  M>(42)(I-T^)'‘[AP(52)y  + 

n. 

+  AP(|2)T(.  2SP(^i)x  +  AP(^2)  I 

AP(^.)  =  AP(^.)(I-T^r^[AP(^.)y  + 

I-  1  S2.  ^  i 

+  AP(^)T^P  ^‘x  +  APd-)!  ^P  J"xj 
1  ^  J 

AP(y  =  AP(5jj)(I-Tcr*[AP(|^)y  + 

+  ^(«n)Tc  (5.  36) 

These  relations  follow  from  the  hypotheses  that  the  Lipschitz  norm  of  is 
less  than  1  and  is  weakly  additive  plus  the  application  of  Proposition 

^  n. 

2. 1.  From  Equation  (5.  36)  we  can  see  that  (I-I  T^)  is  invertible 
am!  its  inverse  (I-I  T^)  is  causal.  From  Proposition  4.4. 1,  to 
prove  that  (I-T)  ^  is  causal  it  is  sufficient  to  show  that  if  y  is  any 
element  of  [H,  P^j  and  t  c  then 

pVt)'V=  pVTl'Vy. 

Assume  for  a  moment  that  for  every  y  e  [H,  P^j  the  following  relation 


holds 
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I  (I-I  T(,)  ■  V  +  (I-T)  ■  V I  ->  0  (5. 37) 

Then  it  follows 

T^)"V}->pVt)“V  and 

T^)  "SV}  ->  pV-T)  "^pV. 

SI. 

But  (I-I  T^)  is  causal  for  each  i=l,  2, . . .  .  Hence 

pV-I  ^-T^)"^y=pVl  '-T^)’Vy 

and  consequently 

pVt)“V=  PVT)'Vy. 

It  remains  to  be  shown  that  Equation  (5. 37)  is  true.  Assume  the  con¬ 
trary.  Then  there  v/ould  exist  a  positive  real  e  and  ['P  J  a  subsequence 
S2. 

of  {l  +  T^}  such  that 

|(I-V'V-  (I-T)“V|  >t.  (5.38) 

In  the  sequel  we  will  show  that  this  equation  cannot  hold.  This  will 
mean  that  our  assumption  is  absurd  and  hence  that  Equation  (5. 37) 
must  be  valid. 

To  start,  denote  {(I-Tj^)'V}  and  (I-T)"V  respectively  by  {x^^} 
and  X  and  observe  that 


(6.  39) 
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Note  also  chat  from  the  boundedness  of  (I-T)  it  follows  that 
is  uniformly  bounded  and  consequently  the  sequ  mce  {x^} 
is  also  uniformly  bounded,  that  is 

|Xnl  =  |a-Tn)"Vl  <M|yl  (5.40) 

where  M  is  a  positive  number  conveniently  chosen. 

The  proof  of  the  uniform  boundedness  of  goes  briefly 

as  follows:  by  the  boundedness  of  (I-T)  ^  there  exists  a  positive  real 
m  such  that  for  every  x  e  [  H,  P^]  the  following  relation  holds 

tei.  >2m. 

fx] 

If  we  now  choose  an  integer  N  such  that  n  >  N  implies  |T-Tj^|  <  m, 
then  for  n  >  N  we  have 


|(I-Tj|)x|  |(I-T)x 


> 


|(T-Tjj)x 

— RTP- 


|(I-TJx 


I'  n'  '  I  1 

It  follows - 1— 1 - >  m  and  this  implies  (I-T  )  <  —  =  M.  This 

|x|  -  n'  '  -  m 

means  that  {(I-T^^)  ~^}  is  uniformly  bounded. 

To  proceed  with  the  proof  of  Equation  (5.  37) ,  consider  now  the 
sequence  {y^}  given  by  =  (I-T)x^.  Observe  that  from  Equations 
(5.39)  and  (5.40)  we  have 


Yn-y 


|(I-T)x„-(I-T„)xJ 
|(T+Tj,)Xn|  <m|t+T^|  Ivj. 


(5.41) 
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Note  also  that  we  cvn  write 

(I-T)'V  -  (I-T)‘V  - 

From  this  equation  and  Equation  (5. 38)  it  follows  that 

i(I-T)'V-  (I-T)'V„I  >€ 

and  applying  Equation  (5. 41)  we  obtain  the  following  relation 

|(I-T)'V-(I-T)-Vj  ^  j 

!Fy;^l  -  m|t-tJ  |y|  • 

Since  the  sequence  {Tj^}  converges  to  T  we  have  that  |t-T^|  can  be 
as  small  as  desired.  As  a  consequence,  the  above  equation  implies 
that  (I-T)”^  is  not  Lipschitz  continuous.  This  is  a  contradiction  to 
hjfpothesis  d)  and  it  can  then  be  concluded  tliat  Equation  (5. 38)  cannot 
indeed  hold. 

- 1 

Corollary  1.  If  T  is  strictly  causal  and  (I-T)  is  invertible  with  (I-T) 
Lipschitz  continuous,  then  (I-T)  ^  is  causal. 

The  rest  of  this  section  illustrates  the  fact  that  the  results  of 
Sections  2  and  3  can  often  be  applied  even  when  the  hypotheses  on  the 
operator  K  are  different  froi.i  those  assumed  in  the  proofs.  In  par¬ 
ticular,  Proposition  1  considers  a  situation  where  K  is  not  weakly 
additive  (Figure  5. 3) .  Proposition  2  considers  a  double  loop  feedback 
system  (Figure  5.4) .  Finally  Proposition  3  treats  a  case  where  K 
is  not  strictly  causal. 
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Proposition  1.  Suppose  that  K  =  N^T  where  and  T  satisfy  the 
following  conditions: 

a)  T  is  linear  bounded  and  strictly  causal 

b)  is  memoryless  invertible  and  both  and 

are  Lipschitz  continuous. 

Then  the  basic  feedback  system  is  stable. 

Proof.  Observe  that  K  is  not  necessarily  weakly  additive  and 
that  Theorem  2. 1  is  not  directly  applicable.  From  Theorem 
2. 1  it  follows  however  that  the  operator  (I-TN^  is  invertible  and 
(I-TN^)  is  bounded  causal  and  continuous.  From  here  it  is  easy 
to  verify  that  the  operator  Y  =  N.{I-TN  )  (NJ  is  also  bounded 

X.  X. 

causal  and  continuous.  Moreover  Y  is  invertible  ana  its  inverse  is 
given  by  the  following  relation 

Y'‘=  [Nj(I-TNj)'V,)'V‘=  Nj(I-TN|,)(Nj)"^=  (I-NjT). 

From  the  above  equation  it  follows  that  (I-N^T)  is  invertible  and  its 
inverse  is  bounded  causal  and  continuous.  This  means  that  the  feed¬ 
back  system  under  consideration  is  stable.  The  proof  of  the  Propo¬ 
sition  is  thus  complete. 

Proposition  2.  Consider  the  system  in  Figure  5.  3  and  suppose  the 


following: 
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a)  K  and  T"  are  linear  and  bounded,  T'  is  Lipschitz 
continuous 

b)  K  is  strictly  causal,  T*  is  memoryless  and  T’*  is  causal. 

Then  the  system  under  consideration  is  stable. 

Proof.  By  Theorem  3. 1  the  system  in  Figure  5. 4  is  equivalent  to  the 
system  in  Figure  5.  5,  where 

oO 

K=  Yj  k"* 

n=l 

Observe  that  the  system  in  Figure  5.  5  is  equivalent  to  the  system  in 
Figure  5. 6.  Moreover  from  the  strict  causality  of  K  and  Theorem 

4.4. 1,  the  operator  IKKT"  +  KT'  is  strictly  causal.  The  desired 
result  follows  at  this  point  from  a  direct  application  of  Theorem 

2.1. 

Proposition  3.  Suppose  that  T  is  linear  and  the  basic  feedback  system 
is  stable  for  K  =  T.  Then  the  basic  feedback  system  is  also  stable 
for  K  =  T  +  K,  where  K  =  and  K^,  satisfy  the  hypotheses  of 

Theorem  2. 1. 

Proof.  Observe  that,  denoting  y  and  x  respectively  as  input  and  output, 
the  systems  in  Figures  5.7  and  5.  8  are  equivalent.  This  can  be  seen 
by  means  of  the  following  equations 


IDY 


Figure  5.  5  Basic  Feedback  System  Equivalent  to  the 
Double  Loop  Feedback  in  Figure  5. 4 


Figure  5. 6  Feedback  System  Equivalent  to  the 
System  in  Figure  5. 4 
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X  =  y  +  l6c  +  Tx 
(I-T)x  =  y  +  l6c 
x=  (I-T)‘V  +  (I-T)"^ 

By  hypothesis  (I-T)  is  linear  causal  and  bounded.  Applying 
Proposition  4.4.4  it  is  immediate  to  verify  that  (I-T)  '^  satisties 
the  hypotheses  of  Theorem  2. 1.  It  follows  that  the  inverse  of 
(I-(I-T)~^)  is  well  defined.  Moreover  (I-(I-T)  ~^K;' is  bounded 
causal  and  continuous. 

By  the  equivalence  of  the  systems  in  Figures  5. 7  and  5. 8  we 
obtain  the  following  relation 

I  -  K  -  T  =  (I-T)(I-(I-T)"^K) 

It  follows 

(I-K-T)‘^  =  (I-(I-T)‘^S)“\l-T)’\ 

Hence  the  inverse  of  (I-K-T)  is  well  defined  and  it  is  bounded  causal 
and  continuous.  The  proof  of  the  Proposition  is  thus  complete. 

5.  5  Applications 

The  theoretical  development  in  this  chapter  has  a  wide  range  of 
applicability  in  the  area  of  functional  analysis  and  stability  theory. 

In  classical  functional  analysis  Theorems  2. 1  and  3, 1  not  only 
offer  a  unified  proof  and  a  physical  interpretation  for  various  and 


Figure  5. 7  Feedback  System  Considered  in  Proposition  3 


u 


Figure  5.  8  A  Feedback  System  Equivalent  to  that  in 
Figure  5.7 
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familiar  results  related  to  linear  and  nonlinear  intograJ  Volterra 
equations,  but  they  also  allow  a  ready  extension  of  some  of  those 
results. 

In  modern  functional  analysis,  Corollary  4.4  gives,  by  a  proper 
reformulation,  an  important  result  which  was  found  by  Brodskii, 
Gohberg  and  Krein.  This  is  Theorem  6.1a),  b)  p.  27  in  [  25  j .  Here 
we  emphasize  that  while  the  proof  offered  by  those  authors  was  based 
on  a  sophisticated  result  from  the  theory  on  the  stability  of  the  spec¬ 
trum  of  bounded  linear  operators,  no  use  of  that  theory  was  made  in 
this  development. 

In  regard  to  stability  theory,  this  is  a  most  fertile  area  of  appli¬ 
cation.  It  should  be  noted  that  Theorem  4. 1  appears  to  fit  nicely  in 
the  general  theoretical  framework  which  was  proposed  by  Damborg 
in  [  11  j .  As  an  illustration  of  some  aspects  of  the  applicability  of 
Theorems  2. 1  and  3. 1,  it  is  helpful  to  discuss  the  stability  problem 
for  some  simple  examples. 

Example  1.  Consider  the  system  in  Figure  5.9.  Suppose  that  this 
system  is  described  as  follows: 

i)  N^,  T’,  T"  are  Lipschitz  continuous  operators  on  the  space 
of  square  integrable  functions  LgfO,  oo); 

ii)  is  memory  less,  T'  and  T"  are  linear  a.nd  causal 

iii)  T'  (or  T")  is  compact. 
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The  theory  of  the  previous  sections  can  be  applied  to  show  that 
this  system  is  stable.  This  result  does  not  depend  on  the  particular 
description  of  T’  and  7”  as  long  as  they  satisfy  i-ii-iii.  However 
the  reader  with  a  special  taste  for  concreteness  may  suppose  the 
following: 

is  the  nonlinear  gain  of  a  memoryless  amplifier 
with  characteristic  curve  indicated  in  Figure  5. 10 
.  T*  represents  a  linear  time  invariant  stable  dynamical 
system  with  a  transfer  function  of  the  type 


N  M 

G.(s)  =  b^s 


m 


n=0 


m=0 


N  <M 


T”  is  an  operator  defined  as  follows:  if  y  =  T”x  then 

t  00  CO  n 

y(t)  =  /  K(t,  s)x(s)  ds,  where  /  /  K^(t,  s)  dtds  <  oo. 

0  0  0 

Consider  the  Hilbert  resolution  space  (HRS)  [L2[0,  oo),  P^J  which 
was  described  in  Example  4.  2. 1  and  recall  that  the  resolution  of  the 
identity  in  this  case  is  continuous.  Clearly,  the  problem  of  the  study 
of  the  stability  of  the  system  under  consideration  can  be  embedded  in 
the  stability  study  of  a  system  in  this  HRS. 

The  operators  T’,  T”  can  be  viewed  as  operators  on  [  0,  oo) ,  P^] . 

Since  T"  is  linear  compact  and  causal  and  R  is  continuous,  Proposition 
4.  7. 8  can  be  applied  and  it  is  obtained  that  T"  is  strictly  causal.  From 


Figure  5.  9  :  Feedback  System  considered  in  Example  i 


Figure  5. 10  ;  An  admissable  nonlinearity. 


163 


the  application  of  Proposition  4.4.4  the  operator  t’T”  is  strictly 
causal.  We  can  then  apply  Theorem  2. 1. 

From  here  it  is  obtained  that  the  system  under  consideration 
is  indeed  stable. 

Example  2.  Consider  the  system  Figure  5. 1. 1.  Suppose  that  this 
system  is  described  as  follows: 

i)  T’,  T",  T  are  operators  on  the  space  of  real  square 
integrable  functions  L2[0,  oo) ; 

ii)  N^,  T*,  T"  and  T  are  described  by  the  followin'^  relations; 

a)  (N^x)  (t)  =  f(x(t) )  where  f(. )  is  a  Lipschitz  ccntinuous 

real  function 

00 

b)  (T'x)(t)  =  Yj  where  /it  >0, 

n=0 

c)  T".x)(t)  =  /g(t-T)  x(7)  dr  where  g(t)  f  Lj[0,oo) ; 

o 

d)  (Tx)(t)  =  h(t)x{t)  where  g(t)  e  LgfO,  oo). 

As  in  example  1,  the  theory  of  the  previous  sections  can  be  applied 
to  show  that  this  system  is  stable. 

Consider  again  the  Hilbert  resolution  space  [  Lgf  0,  co) ,  P^]  defined 
in  Example  4.  2. 1,  Observe  that  the  operator  is  memoryless  and 
the  operator  T(Gj+  Gg)  is  linear,  causal  and  bounded,  Assume,  for 
a  moment,  that 
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/dPT(T' +  T")  dP  =  0.  (5.42) 

Then  by  Theorem  4.4. 1  the  operator  T(T’+T’')  is  strictly  ciiusal. 
Corollary  2.  2  can  then  be  applied  and  it  can  be  concluded  that  the 
system  under  consideration  is  stable. 

In  the  sequel  ihe  validity  of  Equatioii  (5.42)  will  be  proved.  To 
this  purpose  it  will  have  to  be  shown  that  given  any  c  >  0  a  partition 
of  u  =  [ 0,  Qo) ,  =  {O  =  Iq,  ^  Ig, . . . ,  5 =  oo},  can  be  found  such 

that  for  any  other  partition  =  {o  =  ^*o>  ^*2’  ”  ‘ ^ 


Figure  5. 11  ;  Feedback  System  considered  in  Example  2.; 


165 


the  property  Q'  >52^?  the  following  relation  holds 


I  f,  AP(ri)T(T'  +  T")M>(4M|  <e. 

i=l 


Choose  an  element  ^  c  [  0,  oo)  such  that 


Clearly  then 


la-P^)T(I-P^)  !  <  e/2|T*  +  T"|, 


|(I-P')T(T'  +  T’'){I-P^)  I  <e/2. 

_  T 

^  n>  rpil 


(5.43) 


Consider  now  the  operator  P^  7'  T”  P  .  If  x,  y  e  Lgf  0,  oo)  and 

y  =  p^T  T”  P^x,  then 

t  t 

y(t)  =  /h(t)g(t-s)x(s)ds=  /K(t,  s)x(s)  ds 
0  o 


where  k(t,  s)  =  h(t)g(t-s) 
=  0 


for  t  <  I  and  s  <  t 
for  t  >1^  or  s  >t. 


The  kernel  K(t,  s)  has  the  following  property 


00  00 


/  J  K^(t,  s)dtds  <  |h(’)  ’  (oss  sup  g(*))^  •  ^  <  oo. 

0  0 

It  follows  that  the  operator  P^T  T"  P^  is  Hilbert  Schmidt.  As  it  is 
well  known,  Hilbert  Schmidt  operators  are  compact  [  16J . 

By  Proposition  4. 6.  5  it  then  follows 

fdP  p^  T"  P^P  =  0. 


Ififi 


Then  there  exists  a  partition  ^2»  •  •  •  >  =  ®}  such 

that  for  n*  =  {O  =  I 'j,  ^*2»  *  •  • » ^ ^  -  ^Oe ’  following 

relation  holds 

T  T 

I  J  P(rj)P^  T*’  P^  F(r  j  I  <  e/2.  (5.44) 

i=l  ‘ 

Construct  now  a  partition  =  {O  =  ^o»  ^2’ '  "  ’  ^n "" 

following  properties: 


=  “()£•«'  “t-  ““  !«i -  «i-il  <  "“o “ «i  <«• 

Sui^ose  that  fi'  =  (O  =  ^*2»  **  •  >  ^*n'  "  ^  ‘ 

Then  from  Equations  (5.43)  and  (5.44)  it  follows 

n’  7  7 

I  ^  AP(rJT(T’+T")AP(ri)  |<i  AP(ri)P^TT’P'’ AP(^'.)  I  + 

i=l  ^  ‘  itl  ^  ‘ 


|(I-P^)TT'’(I-P^)  I  <f 


where  it  has  been  taken  into  account  the  fact  that 


I  aP(^’.)P^  TT"P^  AP(tV)  i  =  0. 

'  1  1  • 

1=1 

At  this  point  it  can  be  concluded  that  Equation  « 5. 42)  is  indeed  time. 

<1 

5. 6  Summary 

Some  connections  betw  cn  stability  and  ransalitv  have  been 
investigated.  To  this  purpose  an  "atstract"  closed  loco  fe^^dback 


system  has  been  considered.  The  app-oach  adopted  is  oased  on  the 
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axiomatic  framework  of  Chapter  4.  This  allows  a  development  which 
is  simultaneously  applicable  to  continuous  time,  sampled  data  and 
hybrid  ^sterns. 

1  articular  attention  has  been  given  to  some  implications  of  the 
"strict”  causality"  property  of  an  open  loop  system  over  the  stability 
of  the  closed  loop  system.  The  basic  results  are  contained  in  Theorems 
2. 1  and  4. 1.  Theorem  2. 1  represents  the  main  contribution  of  this 
chapter  and  states  that  strict  causality  of  an  open  loop  system  plus 
some  other  "reasonable"  conditions,  guarantees  the  stability  of  the 
closed  loop  system.  Some  of  its  practical  applications  are  illustrated 
by  two  concrete  examples.  At  the  present  time,  Theorem  2. 1  is  con¬ 
fined  to  a  special  class  of  '-weakly  additive"  systems.  Applications  to 
more  general  classes  of  systems  hav(  however  also  been  considered. 

Theorem  4. 1  establishes,  under  appropriate  conditions,  a  con¬ 
nection  between  causality  of  an  open  loop  system  and  causality  of  the 
closed  loop  system.  This  result  appears  to  fit  nicely  in  the  stability 
problem  theoretical  framework  which  was  proposed  by  Damborg  in 

(lil- 
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A.  Some=  Examples  of  Time  Related  Behavioral  Patterns  and 
Engineering  Applications 

In  this  appendix  we  discuss  at  some  length  three  selected  engi- 

! 

neering  examples.  The  objective  is  to  supply  the  reader  with  some 
sort  of  "proving  ground"  for  some  of  the  ideas  and  abstract  con¬ 
siderations  in  Section  1. 1. 

Example  1.  Consider  the  electroacoustic  system  consisting  of  a 
loudspeaker  and  a  microphone  located  in  a  reverberant  chamber 
(Figure  A.  1) .  A  voltage  is  applied  to  the  coil  of  the  loudspeaker 
and  the  voltage  is  measured  at  the  microphone.  Ignoring  transients, 
this  device  can  be  described  as  a  one  input- one  output  linear  time 
invariant  system. 


f 


Figure  A.  1 
\f'6 
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The  output  can  be  viewed  as  the  combinaticm  of  two  signals. 

One  signal  is  due  to  the  direct  acoustic  wave  from  the  loudspeaker; 
the  other  is  due  to  cumulative  reflections  from  the  walls.  Thus  F, 
the  frequency  response  of  the  overall  system,  can  be  expressed  as: 

F(iw)  =Fj(jw)  +  F2(jw)  W£  (-ao,co)  (1) 

where  Fj  represents  the  idealized  direct  transmission  and  F2(jw) 
takes  into  account  the  influence  of  the  walls. 

The  frequency  response  F  can  be  obtained  by  a  combination  of 
experimental  and  analytical  results.  For  example  if  the  speaker- 
microphone  complex  is  located  in  an  anechoic  chamber,  then  to  a  good 
approximation  F2  =  0  r-td  F  =  Fj.  Thus  the  identification  of  F^  by 
experimentation  is  feasible.  Suppose  however  that  an  anechoic  chamber 
is  not  available  or  that  the  chamber  available  is  not  completely  anechoic. 
Then  F_  ^  0  and  the  problem  of  extracting  F.  from  F  arises  [  15  ]. 

Under  normal  experimental  conditions,  the  following  assumptions 
are  satisfied;  the  loudspeaker  has  a  finite  memory,  Atj;  At2= 

>  Atj,  where:  X2  is  the  length  of  the  path  of  the  direct  wave 
from  the  loudspeaker  to  the  microphtme  and  Xj  is  the  siiortest  path 
length  of  the  various  reflected  waves.  The  constant  c  is  the  speed  of 
sound.  In  the  following  we  show  that  the  problem  under  consideration 
can  be  viewed  as  one  .if  identifying  the  anticausal  part  of  a  linear  system. 
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Suppose  that  F  has  been  experimentally  evaluated.  Multiply  it  by 
^jwAto^  with  Atj  <  <  Atg.  From  Equation  (1)  wq.  obtain 

F(jw)  =e^^^^oF(jw)  =e^^^^OFj(jw)  +  =  F^(jw)  +  F^Ow). 

It  is  not  difficult  to  convince  ourselves  that  by  virtue  of  the  above 
assumptions,  Fj  is  the  Fourier  transform  of  an  anticausal  operator 
and  Fg  is  the  Fourier  transform  of  a  causal  operator.  Clearly  then 
the  problem  of  computing  F^  can  be  viewed  as  the  problem  of  identifying 
the  anticausal  component  of  F. 

More  specifically,  the  theoretical  questions  related  to  canonical 
decomposition  become  of  paramount  importance. 

Example  2.  Consider  an  operator,  T,  on  the  space  of  square  integrable 
functions,  b].  To  compute  y(t)=  [  Tx]  (t),  for  a  given  xe  Lafa-b], 
one  might  consider  the  use  of  a  hybrid  computer.  If  T  is  causal  it  may 

be  advantageous  to  simulate  T  on  the  analog  part  oC  the  hybrid  computer 
as  this  generally  leads  to  a  greater  speed  of  computation.  If  T  is  not 
causal  then  this  procedure  is  not  open  to  us.  However,  suppose  one 
could  decompose  T  into  a  causal  component  and  an  anticausal  com¬ 
ponent  T^.  Note  that  every  anticausal  s>’stem  can  be  viewed  as  c-aisal 
if  we  change  the  direction  in  which  ihe  tiioe  flows.  It  follows  then  that 
use  of  the  analog  part  of  the  hybrid  computer  might  oe  salvaged  by  a 
decomposition  and  a  partial  time  reversal. 

To  clarify  -suppose  that  y  =  K  *  f,wherc  K  and  f  are  represented 
in  ficure  A.  2.  Our  s>stem  is  not  causal;  however,  we  c.'in  write: 


172 


K(t)  =  K^(t)  +  K^(r) 

where 

K  (t)=  K(t)  for  r>  0,  K  (t)=  0  for  t  <  0 
'  ®  T  >  0,  K  {t)  =  K(t)  for  t<  0. 

Clearly  is  anticausal  and  is  causal  (see  figure  A.  3)  and  the 
output  y  can  be  expressed  by 

K(,*f 

To  compute  y  taking  full  advantage  of  the  hybrid  computer  we  can 
now  proceed  as  follows:  i)  compute  the  outputs  yj(t)  and  y2(t)  of  the 

and  K^-t)  vath  inputs  respectively  f(t)  and 
f(-t).  ii)  recognize  that  yj(t)  =  (Kq*  f)(t)  and  y2(-t)=  (%  *  f)(t)  and 
hence  compute  y(t)  •=yj(t)  +5^2^'^)' 

Example  3.  Let  us  consider  a  quality  control  problem  related  to  the 
acceptance  or  rejection  of  brake  lining  material  in  the  automotive 
industry  [  lOl,  (  22].  The  quality  control  procedure  consists  of  the 
following: 

i)  Some  laboratory  tests  are  rim  on  the  brake  lining  material 

ii)  The  results  are  compared  with  some  nominal  results 

lii)  A  decision  is  made  concerning  ihe  continued  use  of  the  material 
in  the  production  line. 

The  variations  fwi  this  quality  control  procedure  depend  on 
a  number  of  factors.  Mo.st  important  amop.c  tnrsr  factors  are  the 


two  causal  systems  K^(t) 


choice  of  the  type  of  tests  to  be  run  and  the  criteria  of  interpretation 
to  be  assigned  to  the  results.  A  simplified  version  of  one  of  the  most 
vddely  adopted  solutions  consists  basically  of  three  steps.  A  small 
sample  of  the  brake  lining  material  is  inserted  in  a  chromat(^raphic 
machine  (first  step).  This  test  generates  a  response  voltage,  x(t). 

The  function  x,  which  is  recorded  as  a  chart,  has  a  behavior  which 
depends  on  the  physical  and  chemical  properties  of  the  sample. 
Typically,  x  appears  as  in  figure  A.  4  where  t^  and  t^  indicate  respec¬ 
tively  the  initial  and  terminal  time  of  the  test. 

To  analyze  the  test  result,  a  straight  line,  y(t),  (called  the  drift 
line)  is  superimposed  on  the  graph  of  x  (second  step).  The  purpose  of 
y  is  to  take  into  account  undesirable  effects  which  are  due  to  a  number 
of  sample  independent  sources.  In  order  to  achieve  this  purpose  the 

drift  line  must  ha^re  the  following  properties:  a)  the  difference  x(t)-y(t) 

"  * 

has  to  be  positive  for  every  t  e  ;  b)  the  area  A  between  the 

t 

curve  x(t)  and  the  drift-line  y(t)  (A=  ./  [x(t)  -  y(t)]  dt)  is  minimized 

0 

over  all  straight  lines  satisfying  condition  a). 

In  the  final  test  step,  the  areas  of  well-defined  peaks,  i.e., 

Pj,  P^, . . .  ,Pj^,  are  computed  and  it  is  established  whether  each  peak 
area  is  within  a  certain  predetermined  tolerance  (third  step).  From  a 
functional  analysis  point  of  view,  ‘he  overall  data  reduction  operation 
can  be  viewed  as  a  transformation,  jr,  mapping  a  special  class  of  con- 
tiiiuou.s  functions  in Cf  tp.ijj  into  functions  in  Note  that 
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according  to  extensive  experimental  results  (which  indeed  constitute 
the  essential  foundations  of  the  overall  approach)  the  second  step  can 
be  performed  correctly  only  after  all  of  the  curve  x  is  known.  From 
this  observation  it  follows  that  ir  is  not  a  causal  system. 

Until  recently  the  conventional  test  procedure  was  to  initiate 
second  and  third  steps  after  the  test  was  run.  In  tliis  way  the  delay 
time,  t^,  between  test  initiation  and  test  conclusion  is  given  by  1^= 
t  '^here  t  ^  is  the  time  necessary  to  run  the  test,  t2  is  the 

time  required  to  draw  the  drift  line,  and  tg  is  the  time  needed  to  com¬ 
pute  Pj.P2’  •  *  * » standard  laboratory  techniques,  it  turns 
out  that  ig  is  usually  neglectable  and  that  t  ^  and  t^  are  both  of  the 
order  of  50-60  minutes.  Hence  t^is  in  general  of  the  order  of  100-120 
minutes.  In  the  mean  time  the  production  lines  continue  u&irg  the 
material  under  test.  As  an  alternative  procedure,  observe  that  the 
mapping  ir  can  be  viewed  as  given  by  the  composition  of  two  mappings 
TTj  and  The  mapping  transforms  x  into  {P’J  and  the  mapping 
Ti^  transforms  x  into  {P"J  where  P’^  and  P"^  indicate  the  areas  in 
figure  A.  4.  Clearly  {P.  }  -  {PVj  -  {P"-},  hence  n  further¬ 

more,  it  is  not  difficult  to  recognize  J7j  as  a  causal  mapping  (according 
to  our  development  7r„can  be  easily  identifi^'d  as  a  ’’crosscausal"  mapping) . 

To  implement  the  quality  control  test,  wc  c.','  now  adopt  the 
following  scheme:  compute  {P'. !  while  we  run  the  test,  then  ^ler 
the  lest  is  run  compute  jP''-]  and  finally  compute  the  difference 

t  p»  '  .  '  p”  I 

1 '  i  ■ 
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The  amount  of  time  required  for  the  overall  data  reduction 
operation  in  this  procedure  is  given  l^t=‘tj  +T2  where;  i)  is 
equal  to  t^  Tg  is  the  time  required  to  compute  {P*'J  and  to  evaluate 
the  difference  (P’ }  -  {P”i}.  In  general  it  turns  out  that  ^  is  of  the 
order  of  10-12  minutes.  It  follows  that  this  second  scheme  provides 
a  consistent  economy  of  time  with  respect  to  the  original  one. 


Area  P  ^  Area  A.B.E.F. 
1  111] 


Area  P!  =  Area  A.C.D.F 
1  111 


Area  P”  =  Area  B.C.D.E. 
1  111'] 


Figure  A.  4 
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Fiiure  A. 5 


B.  Some  Selected  Results  on  Integral  Transformators 


In  this  appendix  some  selected  results  on  integrals  on  Hilbert 
resolution  spaces  are  presented  and  briefly  discussed.  These  results 
can  be  found  in  [25]  and  the  reader  is  referred  to  that  reference  for 
proofs  and  further  details.  A  word  of  warning  may  be  in  order:  the 
various  original  lemmas  and  theorems  have  not  been  reproduced  in  a 
faithful  form.  Terminology  and  notations  have  been  regularly  modified 
and,  what  is  more  serious,  range  and  scope  of  applicability  of  some 
results  have,  on  occasion,  been  arbitrarily  limited.  The  main  justi¬ 
fication  for  doing  this  is  the  desire  to  make  these  results  best  suitable 
for  a  direct  use  in  the  various  sections  of  this  stuuy. 

To  start,  the  first  two  results  establish  some  useful  connections 
among  various  types  of  integrals. 


Lemma  1.  ([25]  p.  20) .  For  the  convergence  of  the  integral  /dPT(s) , 

®2  ®1 

it  is  necessary  that  for  any  gap  P  -  P  in  R  the  follow ’ng  relation 


holds 


Ju 


(P  -  P  ")  [T(s2)  -  T(Sj)  ]  =  0. 
Moreover  if  the  integral  rdPT(s)  is  well  defined  then 


/dPTfs)  =  i^dPT(s)  =  5|idPT(s). 

L^emma  2.  Supix)se  that  T  is  a  linear  bounded  operator  on  [H,  P^]. 
If  ^dPTP®  and  fdPTdP  are  well  defined  then  ^dPTdP  is  also  well 
defined..  Moreover  ;he  following  relation  holds 


in 
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5^dPTP®  =  i^dPTF®  +  /dPTdP. 

The  next  lemma  shows  that  in  the  case  of  linear  compact  operators, 
the  transformator  /dP[  ]dP  is  always  well  defined. 

Lemma  3.  ([25],  p.  23  .  Let  T  be  a  linear  compact  operator  on  [E,  P^j. 
Then  / dPTdP  is  well  defined  and  equal  to 

S  Pi')T(P  ■"-  P  ■) 
iew 

where  (P."^,  P-  )  is  the  sequence  of  gaps  in  R.  In  particular  if  R  is 
continuous  then  / dPTdP  =  0. 

Lemma  4  establishes  the  fundamental  connection  between  trans- 
formators  type  /P^TdP  (which  were  used  by  Saeks)  and  transformators 
type  JdPTP®  which  are  adopted  in  the  present  development. 

Lemma  4.  ([25],  p.  26) .  If  T  is  a  bounded  linear  operator  on  [H,  P^] 
and  the  integral  /P®TdP  is  well  defined  then  the  Integral  /dPTP®  is 
also  well  defined.  Moreover,  the  follcwing  relarion  holds 

/dPTP®  -  T  -  /p®TdP. 

The  next  two  Lemmas  5  and  6  play  a  key  role  in  regard  to  the 
question  of  canon’  :;ausality  tecomposition. 

Lemma  5.  (|  25],  Lemma  1  p.  104).  For  any  ox  thogonal  system 
4>j  (j=0, +1. -^2, . . ,.)  in  a  Hilbert  space  H,  ihere  e.xists  a  resolution  of 
the  identity  R  such  that  for  every  selt-adjoint  operator 


179 


+00 


T=  E  (•-*))«< 

j=-co  ■'  •'  ■' 


satisfying  the  conditions 


Aj  >0  {j=l,2, ...),  X.  <0(3=:0,-l, ...) 


+00 


.1 

j=-00 

the  integral  Y  =  /PTdP  diverges  in  the  strong  se  ise.  Conversely  for 
any  continuous  resolution  of  the  identity  R  =  {P*"}  there  exists  an 
orthonormal  system  (i=0, +1, . . . )  sucn  that  the  above  conclusions 
hold  for  the  specified  class  of  sell-adjoint  operators. 

Before  stating  Lemma  6  it  is  convenient  to  introduce  the  following 
definition. 


Definition  1.  An  operator  T  is  called  a  operator  if  it  satisfies  the 
following  conditions: 
i)  T  is  compact 

1  ^2 

ii)  the  spectrum  of  (TT*)  '  \  {sj(T)},  satisfies  the  condition 

+00 

E  (2i-l)'S.(T)<». 

j=-00 

Definition  2.  If  T  t  then  the  expression 

+CO  1 

E  (2j-l)  MT) 

is  called  G  norm  of  T,. 

-w - 
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Lemma  6.  ([25]  Theorem  4. 1,  p.  106) .  Suppose  that  T  e  is  an 
operator  on  a  [H,  and 

(P‘^-  P‘)  T(P'^-  P*)  =  0 

'  I  '  ’ 

for  every  gap  (P^,  P~)  in  K.  Then  the  integral  / PTdP  is  well  defined 
and  it  has  the  precise  bound 

|,/PT(iP|^<  |T  |^. 


I 


C.  Some  Additional  Results  on  the  Causality  Structure  of  Linear 
Systems  in  HRS 

This  appendix  can  be  viewed  as  an  additional  section  to  Chapter  4 
and  gives  some  connections  between  some  causality  properties  of  linear 
systems  in  a  HRS  and  some  of  their  analytic  properties.  In  particular, 
Propositions  1,  2  and  3  illustrate  some  interesting  relations  between 
causality  properties  and  compactness.  Propositions  4  and  5  regard 
the  existence  of  a  canonical  causality  decomposition  for  operators.  * 

Proposition  1.  For  every  linear  compact  operatoi  T  on  a  Hilbert  space 
H,  there  exists  a  ’'maximal*’  resolution  of  the  identity  II  =  {P^}  such 
that  T  is  strictly  causal  with  respect  to  the  HRS  [H,  P^. 

The  proof  of  this  proposition  is  a  direct  consequence  of  a  theorem 
due  to  Aronszajn  and  Smith  and  is  omitted  for  brevity  (see  [25],  Theorem 
3. 1,  p.  15) . 

Proposition  2.  Suppose  that  T  is  a  self-adjoint  operator  on  a  HRS. 

Then, if  T  is  causal  or  anticausal,T  is  memoryiess.  Moreover,  if 
T  =  *  Tp  +  Tj,  then  T*  =  Tj^,  =  T^,  T*  =  T^,. 

Proof.  Suppose  that  T  is  a  self-adjoint  operator  on  [H,  P^.  If  T  is 
causal  then  P^T  =  P^TP^.  Taking  the  adjoint  of  both  members  of  this 
equation  H  follows  T*P^  =  pV*P*.  Using  the  fact  that  T  is  self-adjoint 

*See  Definition  B.  1. 
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it  follows  TP^  =  P*TP^  From  this  equation  and  from  the  dual  of 

Proposition  4. 6. 3,  it  can  be  concluded  that  T  is  anticausal.  Suppose 

now  that  T  =  Then  T*  =  T  *  +  From 

Proposition  4. 6. 1  and  4. 6. 3  it  follows  =  T *  T .  =  T*,  T„  =  T * 

—  _  _  C’  M  M’ 

Proposition  3.  For  every  compact  self-adjoint  operator  T  on  a  Hilbert 
space  H,  there  exists  a  maximal  resolution  of  the  identity  R  =  {P^} 
such  that  T  is  memoryless  v'ith  respect  to  the  HRS  [H, 

Proof.  From  the  compactness  of  T  and  Proposition  1,  there  exists 
a  maximal  resolution  of  the  identity  R  ^  {p*}  such  that  T  is  causal 
with  respect  to  [H,  From  the  fact  that  T  is  self-adjoint  and 
Proposition  2i)  it  follows  that  T  is  memoryless. 


Proposition  4.  Suppose  that  T  is  an  operator  on  a  HRS  and  that  T  e  G  . 
-  w 

Then  a  canonical  causality  decomposition 


T  =  T  *  +  T^  +  T 


M 


always  exists  and  it  is  unique.  Furthermore  the  operator  norms  of 

Ta,  T^,  Tj^  are  bounded  by  the  number 

+00  . 

|tL=  S  (2M)'  siT). 

j=-oo 


Proposition  5.  Suppose  that  T  is  an  ope  .’ator  on  a  Hilbert  space  H  and 
that  T  does  not  belong  to  G.  Then  we  can  find  a  resolution  of  the  iden¬ 
tity  R  =  (P*'}  such  that  T  does  not  have  a  canonical  causality  decompo¬ 
sition  on  [H, 


183 


The  proofs  of  Propositions  4  and  5  are  based  un  Lemmas  B.  5 
and  B.  6  and  are  once  more  omitted  for  brevity.  It  is  important  to 
note  that  according  to  these  two  propositions  the  (I  operators  con- 
stitute  the  largest  class  of  compact  operators  for  which  a  canonical 
causality  decomposition  can  be  guaranteed  in  ger/  "al. 
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